00000001:02000400:3.0F:1784935254.612388:0:3303:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing set_hostid 00000001:02000400:3.0:1784935271.730450:0:3526:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1784935273.575162:0:3589:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 509 MB/s 00000001:01000000:0.0F:1784935273.825350:0:3589:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 659 MB/s 00000001:01000000:2.0F:1784935274.075407:0:3589:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2739 MB/s 00000020:02000000:2.0:1784935275.167319:0:3618:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_207_ge7645ef 00000400:02000000:3.0:1784935276.216028:0:3633:0:(api-ni.c:2824:lnet_startup_lndni()) Added LNI 192.168.203.128@tcp [8/256/0/180] 00008000:02000000:2.0:1784935280.242906:0:3783:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1784935346.130736:0:5752:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1784935359.535691:0:6502:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784935359.535697:0:6502:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1784935359.535699:0:6502:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784935359.535825:0:6502:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000080d1f6df 00000080:02000400:0.0:1784935359.535835:0:6502:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1784935359.540612:0:6502:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1784935359.540624:0:6502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784935359.540646:0:6502:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008b633d72) 00000020:00000080:0.0:1784935359.540663:0:6502:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784935359.587708:0:6502:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1784935359.587781:0:6502:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1784935359.600668:0:6502:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784935359.600880:0:6502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1784935359.600888:0:6502:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784935359.601391:0:6502:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b1604c 00000020:01000004:0.0:1784935359.601398:0:6502:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1784935359.601402:0:6502:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1784935359.601407:0:6502:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000080d1f6df from MGS 00000020:01000004:0.0:1784935359.601411:0:6502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1784935359.601419:0:6502:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000319cd2e1) 00000020:00000080:0.0:1784935359.601429:0:6502:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1784935359.601481:0:6502:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000080d1f6df from MGS, refs=2 00080000:01000000:0.0:1784935359.601485:0:6502:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784935359.601488:0:6502:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b1605a 00000100:00100000:0.0:1784935359.601800:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1784935359.602162:0:6502:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1784935359.602169:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1784935359.607039:0:6502:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1784935359.607052:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1784935359.610749:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935359.611398:0:6502:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1784935359.611405:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784935359.614483:0:6502:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0F:1784935359.614600:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1784935359.615149:0:6502:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1784935359.615157:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1784935359.615817:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935359.615821:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935359.615823:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935359.616225:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935359.616228:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935359.616229:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935359.616740:0:6502:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1784935359.619441:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1784935359.866400:0:6502:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2763 MB/s 00000001:01000000:3.0:1784935360.115995:0:6502:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3251 MB/s 00000001:01000000:3.0:1784935360.366364:0:6502:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 463 MB/s 00000001:01000000:2.0:1784935360.616325:0:6502:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 839 MB/s 00010000:00010000:2.0:1784935360.621121:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1784935360.621419:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1784935360.630469:0:6502:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1784935360.631551:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1784935360.631612:0:6502:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1784935360.631659:0:6502:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1784935360.631965:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1784935360.631989:0:6502:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1784935360.632524:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935360.632882:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1784935360.632889:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784935360.633537:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784935360.633545:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784935360.636400:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784935360.636414:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784935360.637982:0:6502:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784935360.638010:0:6502:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.128@tcp' 00000020:01000004:2.0:1784935360.638012:0:6502:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1784935360.638050:0:6502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.128@tcp (typ=mgc) 00000020:00000080:2.0:1784935360.638070:0:6502:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.128@tcp (0000000038ad2fa5) 00000020:00000080:2.0:1784935360.638088:0:6502:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784935360.638215:0:6502:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000efb8e6c0@MGC192.168.203.128@tcp: add connection 192.168.203.128@tcp at head 00010000:00010000:2.0:1784935360.638367:0:6502:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.128@tcp-0 is initialized 00000040:01000000:2.0:1784935360.638374:0:6502:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.128@tcp ctxt 1 is initialized 00000100:00080000:1.0:1784935360.644232:0:6521:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1784935360.644506:0:6523:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1784935360.644567:0:6502:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.128@tcp (uuid 6dcb3e6c-7883-4388-9dd1-46646343e0f5) 00000020:00000080:1.0:1784935360.644598:0:6502:0:(genops.c:1406:class_connect()) connect: client 6dcb3e6c-7883-4388-9dd1-46646343e0f5, cookie 0x857e02f4e0b16068 00000100:00080000:1.0:1784935360.644609:0:6502:0:(import.c:510:import_select_connection()) MGC192.168.203.128@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784935360.644615:0:6502:0:(import.c:624:import_select_connection()) MGC192.168.203.128@tcp: import 00000000efb8e6c0 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935360.644654:0:6502:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bc7eeec5 x1871640291967104/t0(0) o250->MGC192.168.203.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784935360.644674:0:6502:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS 00000020:01000004:1.0:1784935360.645214:0:6502:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784935360.645221:0:6502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784935360.645244:0:6502:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007b23f0a8) 00000020:00000080:1.0:1784935360.645256:0:6502:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1784935360.647840:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bc7eeec5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3648:1871640291967104:0@lo:250: 00000100:00100000:3.0:1784935360.647963:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935360.648032:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291967104 00000100:00100000:3.0:1784935360.648040:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291967104 00000100:00100000:3.0:1784935360.648081:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935360.648087:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000eec35407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3648:x1871640291967104:12345-0@lo:250: 00010000:00080000:3.0:1784935360.648111:0:6517:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 6dcb3e6c-7883-4388-9dd1-46646343e0f5@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:3.0:1784935360.648136:0:6517:0:(genops.c:1406:class_connect()) connect: client 6dcb3e6c-7883-4388-9dd1-46646343e0f5, cookie 0x857e02f4e0b16076 00000100:00080000:3.0:1784935360.648243:0:6517:0:(import.c:65:import_set_state_nolock()) 000000003fd3d1be : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784935360.648290:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000eec35407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:3648:x1871640291967104:12345-0@lo:250: Request processed in 202us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935360.648297:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784935360.648704:0:3648:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.128@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784935360.648714:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.128@tcp: connect to target with instance 0 00000100:00080000:2.0:1784935360.648720:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.128@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784935360.648725:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784935360.648729:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000efb8e6c0 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784935360.648731:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784935360.648740:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784935360.648745:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bc7eeec5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3648:1871640291967104:0@lo:250: 00000100:00100000:1.0:1784935360.661212:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784935360.661398:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784935360.661405:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1784935360.662204:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1784935360.662212:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1784935360.662634:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1784935360.662641:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1784935360.664094:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784935360.664309:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1784935360.664315:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1784935360.664966:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1784935360.664974:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784935360.709343:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935360.709518:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784935360.709524:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1784935360.711451:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1784935360.711464:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1784935360.712794:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784935360.714883:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784935360.714894:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784935360.716369:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784935360.716383:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784935360.717278:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935360.717463:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784935360.717468:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784935360.718493:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784935360.718503:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784935360.719545:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935360.719797:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784935360.719803:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784935360.724643:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784935360.724655:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1784935360.757347:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784935360.757579:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784935360.757585:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1784935360.762481:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784935360.762498:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784935360.763628:0:6502:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784935360.763638:0:6502:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784935360.764519:0:6502:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784935360.764548:0:6502:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1784935360.764554:0:6502:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.128@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784935360.764666:0:6502:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784935360.764702:0:6502:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.128@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1784935360.764709:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784935360.764711:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784935360.764712:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935360.764713:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935360.764714:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935360.764726:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935360.764727:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784935360.764728:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784935360.764729:0:6502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784935360.764730:0:6502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784935360.764732:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935360.764733:0:6502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784935360.764735:0:6502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1784935360.764737:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784935360.764738:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784935360.764739:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935360.764740:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935360.764741:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935360.764742:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935360.764742:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784935360.764743:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784935360.764744:0:6502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784935360.764745:0:6502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784935360.764746:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935360.764746:0:6502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784935360.764784:0:6502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784935360.764800:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000029453312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967232:0@lo:253: 00000100:00100000:2.0:1784935360.764889:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935360.765017:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 000000004862e50f going to sleep for 11 seconds 00000100:00100000:1.0:1784935360.765198:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291967232 00000100:00100000:1.0:1784935360.765205:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291967232 00000100:00100000:1.0:1784935360.765249:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784935360.765257:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000080a40774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:6502:x1871640291967232:12345-0@lo:253: 20000000:01000000:1.0:1784935360.765299:0:6520:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784935360.765302:0:6520:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1784935360.769537:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784935360.769609:0:6520:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1784935360.769979:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935360.771099:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1784935360.773777:0:6520:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784935360.773786:0:6520:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1784935360.773792:0:6520:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1784935360.773795:0:6520:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1784935360.773809:0:6520:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1784935360.774319:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784935360.774471:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1784935360.774487:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784935360.774504:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1784935360.774520:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1784935360.774535:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1784935360.774599:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1784935360.774607:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1784935360.774620:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1784935360.774626:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1784935360.774636:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1784935360.774641:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1784935360.774650:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1784935360.774663:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1784935360.774688:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1784935360.774694:0:6520:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1784935360.774701:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784935360.774812:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1784935360.774822:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784935360.774836:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1784935360.774867:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1784935360.774884:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1784935360.774892:0:6520:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1784935360.774924:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1784935360.775174:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1784935360.775191:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1784935360.775207:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1784935360.775223:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1784935360.775232:0:6520:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1784935360.775256:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1784935360.775263:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1784935360.775275:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1784935360.775289:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1784935360.775338:0:6520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1784935360.775357:0:6520:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1784935360.775363:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1784935360.776851:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1784935360.777261:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1784935360.777288:0:6520:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.128@tcp for mdt 20000000:01000000:0.0:1784935360.777290:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.128@tcp (null) (null) (null) 00000040:00080000:0.0:1784935360.777305:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1784935360.777310:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1784935360.777322:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1784935360.777327:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.128@tcp (null) (null) 00000040:00080000:0.0:1784935360.777338:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1784935360.777345:0:6520:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1784935360.777358:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1784935360.777372:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1784935360.777400:0:6520:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1784935360.777403:0:6520:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1784935360.777406:0:6520:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1784935360.777469:0:6520:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784935360.777472:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784935360.777896:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1784935360.778242:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1784935360.778279:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1784935360.778304:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1784935360.778313:0:6520:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784935360.778315:0:6520:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784935360.778563:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1784935360.778714:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1784935360.778870:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1784935360.778885:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1784935360.778895:0:6520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784935360.778897:0:6520:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1784935360.778901:0:6520:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1784935360.778904:0:6520:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1784935360.778907:0:6520:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1784935360.778913:0:6520:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1784935360.779501:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1784935360.779632:0:6520:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1784935360.789257:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1784935360.789295:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1784935360.789312:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1784935360.789330:0:6520:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784935360.789349:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b1607d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.789366:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b1607d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.789376:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b1607d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.789381:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b1607d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.789387:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b1607d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.789411:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b1607d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.789416:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c0a6269a already unused, calling callback (000000000ca663c0) 00010000:00010000:0.0:1784935360.789420:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b1607d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.789428:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b1607d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.789440:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b1607d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.789447:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b1607d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.789452:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b1607d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784935360.789469:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784935360.803868:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000080a40774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:6502:x1871640291967232:12345-0@lo:253: Request processed in 38603us (38970us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935360.803884:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935360.808246:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000029453312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967232:0@lo:253: 10000000:01000000:2.0:1784935360.808267:0:6502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784935360.808271:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784935360.808289:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784935360.808290:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935360.808291:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1784935360.808292:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935360.808294:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935360.808295:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784935360.808296:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784935360.808298:0:6502:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784935360.808299:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935360.808301:0:6502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784935360.808320:0:6502:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000080d1f6df from lustre-MDT0000 10000000:01000000:2.0:1784935360.808352:0:6502:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784935360.808355:0:6502:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784935360.808359:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d4572a3b380 10000000:01000000:2.0:1784935360.808363:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784935360.808371:0:6502:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d4572a3b380 from 1 10000000:01000000:2.0:1784935360.808373:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784935360.808412:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935360.808423:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935360.808432:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935360.808450:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000029453312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967360:0@lo:101: 00000100:00100000:2.0:1784935360.808524:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935360.808739:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 000000004862e50f going to sleep for 11 seconds 00000100:00100000:3.0:1784935360.813061:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291967360 00000100:00100000:3.0:1784935360.813076:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291967360 00000100:00100000:3.0:1784935360.813154:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784935360.813176:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000002f0d51ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:6502:x1871640291967360:12345-0@lo:101: 00010000:00010000:3.0:1784935360.813192:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935360.813211:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002264c15a/0x857e02f4e0b1608b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16084 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935360.813235:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002264c15a/0x857e02f4e0b1608b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16084 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935360.813246:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002264c15a/0x857e02f4e0b1608b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16084 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935360.813255:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002264c15a, rc 0) 00000100:00100000:3.0:1784935360.813335:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000002f0d51ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:6502:x1871640291967360:12345-0@lo:101: Request processed in 161us (4812us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935360.813342:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784935360.813532:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000029453312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967360:0@lo:101: 00010000:00010000:1.0:1784935360.813560:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935360.813568:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935360.813649:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006770d848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967488:0@lo:501: 00000100:00100000:1.0:1784935360.813683:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935360.813740:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d5c4b3b5 going to sleep for 11 seconds 00000100:00100000:0.0:1784935360.813855:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291967488 00000100:00100000:0.0:1784935360.813860:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291967488 00000100:00100000:0.0:1784935360.813887:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784935360.813893:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003c12c74b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:6502:x1871640291967488:12345-0@lo:501: 00000100:00100000:0.0:1784935360.813987:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003c12c74b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:6502:x1871640291967488:12345-0@lo:501: Request processed in 94us (303us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784935360.813994:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784935360.814596:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006770d848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967488:0@lo:501: 10000000:01000000:1.0:1784935360.814626:0:6502:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784935360.814646:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935360.814654:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935360.814664:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d4570329000 10000000:01000000:1.0:1784935360.814669:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784935360.814673:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d4570329000 10000000:01000000:1.0:1784935360.814676:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784935360.814678:0:6502:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8d4570329000 from 1 10000000:01000000:1.0:1784935360.814691:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784935360.814729:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 00000000d0913123/0x857e02f4e0b16092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935360.814737:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 00000000d0913123/0x857e02f4e0b16092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935360.814744:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 00000000d0913123/0x857e02f4e0b16092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935360.814758:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006770d848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967616:0@lo:101: 00000100:00100000:1.0:1784935360.814791:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935360.814821:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d5c4b3b5 going to sleep for 11 seconds 00000100:00100000:0.0:1784935360.814913:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291967616 00000100:00100000:0.0:1784935360.814919:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291967616 00000100:00100000:0.0:1784935360.814982:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784935360.814989:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b175c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:6502:x1871640291967616:12345-0@lo:101: 00010000:00010000:0.0:1784935360.815009:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935360.815020:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b16099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16092 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.815038:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b16099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16092 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.815046:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0a6269a/0x857e02f4e0b16099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16092 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.815054:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0a6269a, rc 0) 00000100:00100000:0.0:1784935360.815086:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b175c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+7:6502:x1871640291967616:12345-0@lo:101: Request processed in 98us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935360.815092:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784935360.815354:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006770d848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967616:0@lo:101: 00010000:00010000:1.0:1784935360.815366:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 00000000d0913123/0x857e02f4e0b16092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935360.815374:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 00000000d0913123/0x857e02f4e0b16092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935360.815387:0:6502:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784935360.815399:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 00000000d0913123/0x857e02f4e0b16092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935360.815405:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 00000000d0913123/0x857e02f4e0b16092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935360.815411:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784935360.815414:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784935360.815419:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d4570329000 10000000:01000000:1.0:1784935360.815428:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784935360.815431:0:6502:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784935360.815433:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784935360.815448:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935360.815455:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935360.815460:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935360.815472:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006770d848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967744:0@lo:101: 00000100:00100000:1.0:1784935360.815498:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935360.815525:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d5c4b3b5 going to sleep for 11 seconds 00000100:00100000:0.0:1784935360.815672:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291967744 00000100:00100000:0.0:1784935360.815677:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291967744 00000100:00100000:0.0:1784935360.815708:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784935360.815714:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000006bab6beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+7:6502:x1871640291967744:12345-0@lo:101: 00010000:00010000:0.0:1784935360.815733:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935360.815741:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2f862a6/0x857e02f4e0b160a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b160a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.815754:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2f862a6/0x857e02f4e0b160a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b160a0 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.815762:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2f862a6/0x857e02f4e0b160a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b160a0 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.815778:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2f862a6, rc 0) 00000100:00100000:0.0:1784935360.815813:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000006bab6beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+8:6502:x1871640291967744:12345-0@lo:101: Request processed in 99us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935360.815819:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784935360.815948:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006770d848 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967744:0@lo:101: 00010000:00010000:2.0:1784935360.815959:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935360.815975:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935360.816047:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967872:0@lo:501: 00000100:00100000:2.0:1784935360.816072:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935360.816097:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 000000008cedb51d going to sleep for 11 seconds 00000100:00100000:0.0:1784935360.816252:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291967872 00000100:00100000:0.0:1784935360.816257:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291967872 00000100:00100000:0.0:1784935360.816274:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784935360.816279:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000031e7102e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+8:6502:x1871640291967872:12345-0@lo:501: 00000100:00100000:0.0:1784935360.816383:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000031e7102e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+9:6502:x1871640291967872:12345-0@lo:501: Request processed in 103us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935360.816390:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784935360.816458:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291967872:0@lo:501: 00000100:00100000:2.0:1784935360.816484:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968000:0@lo:503: 00000100:00100000:2.0:1784935360.816519:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935360.816538:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 000000008cedb51d going to sleep for 11 seconds 00000100:00100000:3.0:1784935360.816664:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291968000 00000100:00100000:3.0:1784935360.816668:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291968000 00000100:00100000:3.0:1784935360.816687:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784935360.816693:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005d1963ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+9:6502:x1871640291968000:12345-0@lo:503: 00000100:00100000:3.0:1784935360.816863:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005d1963ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+9:6502:x1871640291968000:12345-0@lo:503: Request processed in 170us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935360.816870:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784935360.816955:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968000:0@lo:503: 00000100:00100000:2.0:1784935360.819813:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6547:1871640291968128:0@lo:502: 00000100:00100000:2.0:1784935360.819892:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935360.819998:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set 000000004862e50f going to sleep for 11 seconds 00000100:00100000:3.0:1784935360.822786:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291968128 00000100:00100000:3.0:1784935360.822803:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291968128 00000100:00100000:3.0:1784935360.822860:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784935360.822869:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000004e695646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+9:6547:x1871640291968128:12345-0@lo:502: 00000100:00100000:3.0:1784935360.823093:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000004e695646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+9:6547:x1871640291968128:12345-0@lo:502: Request processed in 225us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935360.823110:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935360.823473:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6547:1871640291968128:0@lo:502: 00000020:01000000:2.0:1784935360.823507:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935360.823517:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935360.823519:0:6547:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784935360.823523:0:6547:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784935360.823526:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784935360.823608:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000303eb722) 00000020:00000080:2.0:1784935360.823626:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784935360.823632:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784935360.823724:0:6547:0:(osd_handler.c:8933:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784935360.823731:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b160b5 00000020:00000080:2.0:1784935360.825701:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784935360.825866:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935360.825888:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935360.825890:0:6547:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784935360.825893:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935360.825897:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935360.825898:0:6547:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784935360.825901:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784935360.825913:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000bf8d1e34) 00000020:00000080:2.0:1784935360.825994:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784935360.826069:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784935360.826072:0:6547:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784935360.826074:0:6547:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784935360.826081:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784935360.826162:0:6547:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000080d1f6df from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784935360.826175:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000503530f) 00000020:00000080:2.0:1784935360.826183:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1784935360.826245:0:6547:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784935360.826251:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b160ca 00000020:00000080:2.0:1784935360.826380:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784935360.826387:0:6547:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784935360.826392:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x857e02f4e0b160d1 00080000:01000000:2.0:1784935360.826397:0:6547:0:(osd_handler.c:8933:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784935360.826400:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b160d8 00080000:10000000:2.0:1784935360.827248:0:6547:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1784935360.827395:0:6547:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1784935360.832332:0:6547:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1784935360.935852:0:6547:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1784935360.936729:0:6547:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1784935360.943778:0:6547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1784935360.944489:0:6547:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784935360.947007:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a8d421f1) 00000020:00000080:2.0:1784935360.947039:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784935360.947260:0:6547:0:(osd_handler.c:8933:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784935360.947267:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b160e6 00000020:00000080:3.0:1784935360.949337:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1784935360.950355:0:6547:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1784935360.965408:0:6547:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1784935360.970512:0:6547:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1784935360.976827:0:6547:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1784935360.982304:0:6547:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1784935360.984787:0:6547:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1784935360.989897:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x857e02f4e0b160ed 00000020:00000080:0.0:1784935360.990248:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1784935360.990257:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935360.990262:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935360.990264:0:6547:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1784935360.990266:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784935360.990270:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935360.990271:0:6547:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784935360.990273:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784935360.990275:0:6547:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784935360.990277:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935360.990279:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935360.990280:0:6547:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784935360.990282:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784935360.990286:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935360.990287:0:6547:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1784935360.990290:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784935360.990490:0:6547:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1784935360.990617:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6547:1871640291968256:0@lo:502: 00000100:00100000:0.0:1784935360.990682:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935360.990753:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set 00000000273b343f going to sleep for 11 seconds 00000100:00100000:1.0:1784935360.990794:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291968256 00000100:00100000:1.0:1784935360.990800:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291968256 00000100:00100000:1.0:1784935360.990867:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784935360.990875:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005633b4ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+9:6547:x1871640291968256:12345-0@lo:502: 00000100:00100000:1.0:1784935360.991014:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005633b4ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+9:6547:x1871640291968256:12345-0@lo:502: Request processed in 140us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935360.991021:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784935360.991099:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6547:1871640291968256:0@lo:502: 00000020:01000000:0.0:1784935360.991123:0:6547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935360.991128:0:6547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935360.991129:0:6547:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1784935360.991133:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1784935360.992115:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1784935360.992147:0:6502:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784935360.992161:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935360.992172:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935360.992180:0:6502:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4570329000 from 1 10000000:01000000:2.0:1784935360.992182:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784935360.992209:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935360.992216:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935360.992224:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935360.992240:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968384:0@lo:101: 00000100:00100000:2.0:1784935360.992281:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935360.992829:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bd850616 going to sleep for 11 seconds 00000100:00100000:0.0:1784935360.992866:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291968384 00000100:00100000:0.0:1784935360.992872:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291968384 00000100:00100000:0.0:1784935360.992905:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784935360.992912:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005f3530f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+9:6502:x1871640291968384:12345-0@lo:101: 00010000:00010000:0.0:1784935360.992947:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935360.992962:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f839d4de/0x857e02f4e0b160fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b160f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.992983:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f839d4de/0x857e02f4e0b160fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b160f4 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.992991:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f839d4de/0x857e02f4e0b160fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b160f4 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935360.992998:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f839d4de, rc 0) 00000100:00100000:0.0:1784935360.993036:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005f3530f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+10:6502:x1871640291968384:12345-0@lo:101: Request processed in 125us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935360.993042:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784935360.993138:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968384:0@lo:101: 00010000:00010000:2.0:1784935360.993151:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935360.993159:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935360.994022:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968512:0@lo:256: 00000100:00100000:2.0:1784935360.994075:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935360.994101:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bd850616 going to sleep for 11 seconds 00000100:00100000:0.0:1784935360.994521:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291968512 00000100:00100000:0.0:1784935360.994528:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291968512 00000100:00100000:0.0:1784935360.994568:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784935360.994589:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000002525fe44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+10:6502:x1871640291968512:12345-0@lo:256: 20000000:01000000:0.0:1784935360.994606:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784935360.994611:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1784935360.994686:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000002525fe44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+10:6502:x1871640291968512:12345-0@lo:256: Request processed in 99us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935360.994693:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784935360.996472:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968512:0@lo:256: 10000000:01000000:2.0:1784935360.997524:0:6502:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784935360.997597:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935360.997610:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935360.997617:0:6502:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4570329000 from 1 10000000:01000000:2.0:1784935360.997619:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784935360.997654:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935360.997662:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935360.997671:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935360.997700:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968640:0@lo:101: 00000100:00100000:2.0:1784935360.997756:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935360.997840:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bd850616 going to sleep for 11 seconds 00000100:00100000:3.0:1784935360.997854:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291968640 00000100:00100000:3.0:1784935360.997860:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291968640 00000100:00100000:3.0:1784935360.998798:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784935360.998809:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000df2e0dfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+10:6502:x1871640291968640:12345-0@lo:101: 00010000:00010000:3.0:1784935360.998823:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935360.998837:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000070594ba8/0x857e02f4e0b16109 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16102 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935360.998869:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000070594ba8/0x857e02f4e0b16109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16102 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935360.998878:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000070594ba8/0x857e02f4e0b16109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16102 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935360.998885:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000070594ba8, rc 0) 00000100:00100000:3.0:1784935360.998957:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000df2e0dfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:6502:x1871640291968640:12345-0@lo:101: Request processed in 152us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935360.998963:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784935360.999064:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968640:0@lo:101: 00010000:00010000:2.0:1784935360.999077:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935360.999084:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935360.999169:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968768:0@lo:501: 00000100:00100000:2.0:1784935360.999196:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935360.999524:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bd850616 going to sleep for 11 seconds 00000100:00100000:0.0:1784935360.999605:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291968768 00000100:00100000:0.0:1784935360.999610:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291968768 00000100:00100000:0.0:1784935360.999636:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784935360.999642:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000007033eecb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:6502:x1871640291968768:12345-0@lo:501: 00000100:00100000:0.0:1784935360.999831:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000007033eecb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:6502:x1871640291968768:12345-0@lo:501: Request processed in 189us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935360.999839:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784935360.999901:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968768:0@lo:501: 00000100:00100000:2.0:1784935360.999965:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968896:0@lo:503: 00000100:00100000:2.0:1784935361.000004:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935361.000024:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bd850616 going to sleep for 11 seconds 00000100:00100000:0.0:1784935361.000141:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291968896 00000100:00100000:0.0:1784935361.000146:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291968896 00000100:00100000:0.0:1784935361.000165:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784935361.000170:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ff4b511d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:6502:x1871640291968896:12345-0@lo:503: 00000040:00080000:0.0:1784935361.000199:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784935361.000232:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ff4b511d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:6502:x1871640291968896:12345-0@lo:503: Request processed in 62us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935361.000239:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784935361.000315:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086daec80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291968896:0@lo:503: 00000040:00080000:2.0:1784935361.001437:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1784935361.001593:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1784935361.001611:0:6502:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784935361.001628:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935361.001638:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935361.001698:0:6502:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784935361.001701:0:6502:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d4570329000 10000000:01000000:0.0:1784935361.001703:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d4570329000 10000000:01000000:0.0:1784935361.001707:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784935361.001711:0:6502:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4570329000 from 1 10000000:01000000:0.0:1784935361.001714:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784935361.001742:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935361.001749:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935361.001758:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935361.001774:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291969024:0@lo:101: 00000100:00100000:0.0:1784935361.001817:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935361.001847:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 000000004b7e75f1 going to sleep for 11 seconds 00000100:00100000:0.0:1784935361.001863:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291969024 00000100:00100000:0.0:1784935361.001868:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291969024 00000100:00100000:0.0:1784935361.001893:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784935361.001899:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000e4ae5931 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:6502:x1871640291969024:12345-0@lo:101: 00010000:00010000:0.0:1784935361.001921:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935361.001995:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb15c014/0x857e02f4e0b16117 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935361.002016:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb15c014/0x857e02f4e0b16117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16110 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935361.002036:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb15c014/0x857e02f4e0b16117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16110 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935361.002044:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb15c014, rc 0) 00000100:00100000:0.0:1784935361.002076:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000e4ae5931 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6502:x1871640291969024:12345-0@lo:101: Request processed in 178us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935361.002082:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784935361.002128:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291969024:0@lo:101: 00010000:00010000:0.0:1784935361.002139:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935361.002147:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935361.002188:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291969152:0@lo:501: 00000100:00100000:0.0:1784935361.002210:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935361.002218:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 000000004b7e75f1 going to sleep for 11 seconds 00000100:00100000:0.0:1784935361.002236:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291969152 00000100:00100000:0.0:1784935361.002239:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291969152 00000100:00100000:0.0:1784935361.002254:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784935361.002258:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000d8d5529e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6502:x1871640291969152:12345-0@lo:501: 00000100:00100000:0.0:1784935361.002346:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000d8d5529e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6502:x1871640291969152:12345-0@lo:501: Request processed in 87us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935361.002352:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784935361.002374:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291969152:0@lo:501: 00000100:00100000:0.0:1784935361.002397:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291969280:0@lo:503: 00000100:00100000:0.0:1784935361.002434:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935361.002442:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 000000004b7e75f1 going to sleep for 11 seconds 00000100:00100000:0.0:1784935361.002457:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291969280 00000100:00100000:0.0:1784935361.002461:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291969280 00000100:00100000:0.0:1784935361.002475:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784935361.002479:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000385e144d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6502:x1871640291969280:12345-0@lo:503: 00000100:00100000:0.0:1784935361.002549:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000385e144d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6502:x1871640291969280:12345-0@lo:503: Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935361.002555:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784935361.002594:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291969280:0@lo:503: 00000100:00100000:0.0:1784935361.002781:0:6552:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6552:1871640291969408:0@lo:502: 00000100:00100000:0.0:1784935361.002811:0:6552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935361.002829:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291969408 00000100:00100000:0.0:1784935361.002832:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291969408 00000100:00100000:0.0:1784935361.002849:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784935361.002853:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000079d12d9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6552:x1871640291969408:12345-0@lo:502: 00000100:00100000:0.0:1784935361.002913:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000079d12d9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6552:x1871640291969408:12345-0@lo:502: Request processed in 59us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935361.002919:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784935361.002971:0:6552:0:(client.c:2702:ptlrpc_set_wait()) set 0000000047da2149 going to sleep for 11 seconds 00000100:00100000:0.0:1784935361.002983:0:6552:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6552:1871640291969408:0@lo:502: 00000020:01000004:0.0:1784935361.003028:0:6552:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784935361.003042:0:6552:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002f099159) 00000020:00000080:0.0:1784935361.003056:0:6552:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1784935361.003221:0:6552:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000080d1f6df from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784935361.003226:0:6552:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000080d1f6df from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784935361.003233:0:6552:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000080d1f6df 4 00010000:00080000:0.0:1784935361.003258:0:6552:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c686ef54@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.128@tcp at head 00010000:00010000:0.0:1784935361.009692:0:6552:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1784935361.009804:0:6552:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784935361.009845:0:6552:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784935361.009855:0:6552:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x857e02f4e0b16125 00000100:00080000:0.0:1784935361.009864:0:6552:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784935361.009869:0:6552:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c686ef54 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:0.0:1784935361.009900:0:6552:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006ebee3a1 x1871640291969536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784935361.009940:0:6552:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784935361.009971:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871640291969536:0@lo:38: 00000100:00100000:2.0:1784935361.010035:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935361.010136:0:6552:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000869862a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6552:1871640291969664:0@lo:502: 00000100:00100000:0.0:1784935361.010177:0:6552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935361.010201:0:6552:0:(client.c:2702:ptlrpc_set_wait()) set 0000000047da2149 going to sleep for 11 seconds 00000100:00100000:2.0:1784935361.010606:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291969664 00000100:00100000:2.0:1784935361.010613:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291969664 00000100:00100000:2.0:1784935361.010657:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784935361.010665:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000009b9e45d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6552:x1871640291969664:12345-0@lo:502: 00000100:00100000:2.0:1784935361.010782:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000009b9e45d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6552:x1871640291969664:12345-0@lo:502: Request processed in 118us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935361.010789:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784935361.010872:0:6552:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000869862a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6552:1871640291969664:0@lo:502: 00000040:00080000:0.0:1784935361.010898:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1784935361.010972:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1784935361.010991:0:6502:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784935361.011010:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935361.011019:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784935361.011069:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784935361.011071:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784935361.011072:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935361.011073:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935361.011074:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935361.011075:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935361.011076:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784935361.011078:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784935361.011079:0:6502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784935361.011080:0:6502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784935361.011082:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935361.011083:0:6502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784935361.011087:0:6502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1784935361.011090:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784935361.011091:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784935361.011092:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935361.011093:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935361.011094:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935361.011095:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935361.011096:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784935361.011097:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784935361.011098:0:6502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784935361.011099:0:6502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784935361.011100:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935361.011101:0:6502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784935361.011115:0:6502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784935361.011124:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073b6de5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291969792:0@lo:253: 00000100:00100000:2.0:1784935361.011154:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935361.011181:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f26e3333 going to sleep for 11 seconds 00000100:00100000:0.0:1784935361.011463:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291969792 00000100:00100000:0.0:1784935361.011468:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291969792 00000100:00100000:0.0:1784935361.011502:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784935361.011508:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000b33fd84e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6502:x1871640291969792:12345-0@lo:253: 20000000:01000000:0.0:1784935361.011526:0:6517:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784935361.011549:0:6517:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1784935361.012109:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291969536 00000100:00100000:1.0:1784935361.012115:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291969536 00000100:00100000:1.0:1784935361.012191:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784935361.012195:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000086daec80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1871640291969536:12345-0@lo:38: 00000100:00100000:1.0:1784935361.012261:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000086daec80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1871640291969536:12345-0@lo:38: Request processed in 64us (2227us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784935361.012268:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935361.012330:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784935361.012337:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000c686ef54 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784935361.012341:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784935361.012344:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ebee3a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871640291969536:0@lo:38: 20000000:01000000:0.0:1784935361.019520:0:6517:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784935361.019642:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1784935361.019965:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000b33fd84e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6502:x1871640291969792:12345-0@lo:253: Request processed in 8453us (8807us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935361.019977:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784935361.020076:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073b6de5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6502:1871640291969792:0@lo:253: 10000000:01000000:2.0:1784935361.020088:0:6502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784935361.020097:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784935361.020099:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784935361.020100:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935361.020101:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935361.020112:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935361.020113:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935361.020115:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784935361.020116:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784935361.020117:0:6502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784935361.020118:0:6502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784935361.020120:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935361.020121:0:6502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784935361.020135:0:6502:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1784935361.020619:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784935361.020624:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784935361.020639:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.020653:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f839d4de/0x857e02f4e0b160fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b160f4 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.020661:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.020824:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f839d4de/0x857e02f4e0b160fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b160f4 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.020840:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f839d4de/0x857e02f4e0b160fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b160f4 expref: 11 pid: 6517 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935361.020853:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005061a161 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640291969920:0@lo:104: 00000100:00100000:3.0:1784935361.020891:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935361.020994:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fe6dc571 going to sleep for 11 seconds 00080000:10000000:2.0:1784935361.023372:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1784935361.023536:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:0.0:1784935361.023718:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291969920 00000100:00100000:0.0:1784935361.023734:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291969920 00000100:00100000:0.0:1784935361.023787:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784935361.023795:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000009af2a5d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6541:x1871640291969920:12345-0@lo:104: 00010000:00010000:0.0:1784935361.023811:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935361.023894:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935361.023900:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000009af2a5d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6541:x1871640291969920:12345-0@lo:104: Request processed in 107us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935361.023907:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935361.024143:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005061a161 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640291969920:0@lo:104: 00010000:00010000:3.0:1784935361.024169:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024347:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935361.024352:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024367:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030b28468 already unused, calling callback (00000000de675cc8) 10000000:00010000:3.0:1784935361.024370:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024378:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935361.024384:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935361.024390:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935361.024428:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024435:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935361.024453:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024459:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: 0000000030b28468/0x857e02f4e0b160f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b160fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024475:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935361.024477:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935361.024478:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935361.024561:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005061a161 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640291970048:0@lo:103: 00000100:00100000:2.0:1784935361.024610:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935361.024682:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291970048 00000100:00100000:3.0:1784935361.024687:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291970048 00010000:00010000:3.0:1784935361.024705:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f839d4de/0x857e02f4e0b160fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b160f4 expref: 12 pid: 6517 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935361.024725:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935361.024737:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000073b6de5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:3650:x1871640291970048:12345-0@lo:103: 00010000:00010000:3.0:1784935361.024748:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935361.024753:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f839d4de/0x857e02f4e0b160fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b160f4 expref: 12 pid: 6517 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024763:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f839d4de/0x857e02f4e0b160fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b160f4 expref: 12 pid: 6517 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024775:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f839d4de/0x857e02f4e0b160fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b160f4 expref: 12 pid: 6517 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024787:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024793:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784935361.024806:0:6510:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004182949s 00010000:00010000:3.0:1784935361.024810:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024816:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024822:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024827:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024832:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000089ee8b22 already unused, calling callback (000000000ca663c0) 00010000:00010000:3.0:1784935361.024839:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024845:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024856:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024865:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935361.024895:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000073b6de5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:3650:x1871640291970048:12345-0@lo:103: Request processed in 159us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935361.024901:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935361.024943:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005061a161 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640291970048:0@lo:103: 00010000:00010000:3.0:1784935361.024960:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024965:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935361.024970:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000089ee8b22/0x857e02f4e0b1612c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1784935361.025195:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1784935361.025527:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1784935361.025957:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1784935361.026182:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1784935361.028046:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1784935361.028209:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1784935361.028690:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1784935361.028920:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1784935361.029282:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1784935361.029862:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1784935361.033389:0:6502:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1784935361.053919:0:6502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784935361.054147:0:6557:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1784935361.054152:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1784935361.054311:0:6558:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1784935361.056791:0:6502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784935361.056902:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784935361.057347:0:6502:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784935361.057356:0:6502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784935361.057457:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784935361.058448:0:6502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784935361.059009:0:6502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784935361.059041:0:6502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784935361.059213:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784935361.059451:0:6502:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1784935361.064258:0:6558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1784935361.069513:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1784935361.069756:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000040:00080000:0.0:1784935361.074856:0:6558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784935361.074956:0:6558:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784935361.074961:0:6558:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1784935361.076311:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1784935361.076847:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1784935361.077881:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1784935361.078191:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1784935361.078847:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1784935361.079141:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1784935361.079297:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1784935361.079647:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1784935361.080051:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1784935361.080253:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1784935361.080515:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1784935361.080669:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1784935361.081073:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1784935361.081220:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1784935361.081917:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1784935361.082164:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1784935361.082298:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1784935361.082615:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1784935361.085120:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1784935361.085325:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1784935361.085615:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1784935361.086027:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1784935361.086184:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1784935361.086357:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1784935361.086633:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1784935361.087032:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1784935361.087180:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1784935361.087325:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1784935361.087607:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1784935361.087898:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1784935361.088204:0:6502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1784935361.093880:0:6502:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784935361.093918:0:6502:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadd441c7b988 00100000:10000000:1.0:1784935361.093962:0:6502:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1784935361.104547:0:6502:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784935361.104641:0:6502:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.128@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784935361.104668:0:6502:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1784935361.104690:0:6502:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1784935361.107284:0:6502:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784935361.107614:0:6502:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1784935361.645186:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935362.671307:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935363.693059:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935364.717273:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784935365.182475:0:6803:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784935365.741250:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784935366.060975:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784935366.060985:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4570329000 from 3 10000000:01000000:1.0:1784935366.060989:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784935366.061031:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935366.061043:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935366.061053:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935366.061075:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002b90ddec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291970176:0@lo:101: 00000100:00100000:1.0:1784935366.061149:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935366.061206:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 000000006245569d going to sleep for 11 seconds 00000100:00100000:2.0:1784935366.061253:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291970176 00000100:00100000:2.0:1784935366.061260:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291970176 00000100:00100000:2.0:1784935366.061318:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784935366.061326:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000002477c2e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:6523:x1871640291970176:12345-0@lo:101: 00010000:00010000:2.0:1784935366.061339:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935366.061356:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d880ddf/0x857e02f4e0b1613a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16133 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935366.061383:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d880ddf/0x857e02f4e0b1613a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16133 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935366.061392:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d880ddf/0x857e02f4e0b1613a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16133 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935366.061399:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d880ddf, rc 0) 00000100:00100000:2.0:1784935366.061442:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000002477c2e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6523:x1871640291970176:12345-0@lo:101: Request processed in 118us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935366.061448:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784935366.061660:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002b90ddec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291970176:0@lo:101: 00010000:00010000:1.0:1784935366.061676:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935366.061690:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935366.061876:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002b90ddec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291970304:0@lo:256: 00000100:00100000:1.0:1784935366.061912:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935366.061951:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 000000006245569d going to sleep for 11 seconds 00000100:00100000:3.0:1784935366.063407:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291970304 00000100:00100000:3.0:1784935366.063420:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291970304 00000100:00100000:3.0:1784935366.063469:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784935366.063476:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005270aafb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6523:x1871640291970304:12345-0@lo:256: 20000000:01000000:3.0:1784935366.063499:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784935366.063513:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784935366.063516:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1784935366.063635:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005270aafb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6523:x1871640291970304:12345-0@lo:256: Request processed in 159us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935366.063642:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1784935366.064451:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784935366.064457:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784935366.064460:0:36:0:(import.c:65:import_set_state_nolock()) 00000000c686ef54 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935366.064468:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c686ef54 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935366.064495:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000326b3039 x1871640291970432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935366.064654:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000326b3039 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871640291970432:0@lo:38: 00000100:00100000:0.0:1784935366.065177:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935366.065257:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002b90ddec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291970304:0@lo:256: 10000000:01000000:1.0:1784935366.065446:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784935366.065454:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935366.065464:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935366.065489:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291970432 00000100:00100000:1.0:1784935366.065495:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291970432 00000100:00100000:1.0:1784935366.065553:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784935366.065558:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000869862a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1871640291970432:12345-0@lo:38: 00010000:00080000:1.0:1784935366.065578:0:6527:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1784935366.065618:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x857e02f4e0b16141 00000004:00100000:1.0:1784935366.065649:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784935366.065749:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000807c2724 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935366.065819:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000869862a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871640291970432:12345-0@lo:38: Request processed in 259us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935366.065826:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784935366.070482:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000326b3039 x1871640291970432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784935366.070503:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784935366.070583:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784935366.070592:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784935366.070595:0:3648:0:(import.c:65:import_set_state_nolock()) 00000000c686ef54 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784935366.070602:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000326b3039 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871640291970432:0@lo:38: 00000020:00000004:1.0:1784935366.093601:0:6855:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784935366.093777:0:6855:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784935366.768047:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935367.797234:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935368.815906:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784935369.081653:0:6956:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784935369.081842:0:6956:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784935369.840702:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935370.876120:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935371.183383:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001d9658b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291970560:0@lo:400: 00000100:00100000:3.0:1784935371.183463:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935371.183526:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935371.183540:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000074e305a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640291970688:0@lo:400: 00000100:00100000:3.0:1784935371.183570:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935371.183637:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291970688 00000100:00100000:3.0:1784935371.183654:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291970688 00000100:00100000:3.0:1784935371.183696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935371.183704:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005061a161 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640291970688:12345-0@lo:400: 00000100:00100000:3.0:1784935371.183766:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005061a161 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640291970688:12345-0@lo:400: Request processed in 63us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935371.183773:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784935371.183814:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000074e305a9 x1871640291970688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935371.183828:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000074e305a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640291970688:0@lo:400: 00000100:00100000:0.0:1784935371.184073:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291970560 00000100:00100000:0.0:1784935371.184079:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291970560 00000100:00100000:0.0:1784935371.184114:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935371.184120:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000007df8f0ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:3651:x1871640291970560:12345-0@lo:400: 00000100:00100000:0.0:1784935371.184182:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000007df8f0ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:3651:x1871640291970560:12345-0@lo:400: Request processed in 63us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935371.184188:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935371.184220:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001d9658b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291970560:0@lo:400: 00010000:00010000:2.0:1784935371.885079:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935372.911781:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935373.933126:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935374.961037:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935375.982066:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935376.301147:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001d9658b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291970816:0@lo:400: 00000100:00100000:2.0:1784935376.301222:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935376.301280:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935376.301286:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000059438ba0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640291970944:0@lo:400: 00000100:00100000:2.0:1784935376.301311:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935376.301351:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291970944 00000100:00100000:2.0:1784935376.301358:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291970944 00000100:00100000:2.0:1784935376.301401:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935376.301408:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000009ee017b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640291970944:12345-0@lo:400: 00000100:00100000:0.0:1784935376.301525:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291970816 00000100:00100000:0.0:1784935376.301529:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291970816 00000100:00100000:0.0:1784935376.301556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784935376.301561:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000a398c9b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:3649:x1871640291970816:12345-0@lo:400: 00000100:00100000:0.0:1784935376.301601:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000a398c9b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:3649:x1871640291970816:12345-0@lo:400: Request processed in 39us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935376.301607:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784935376.301684:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000009ee017b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640291970944:12345-0@lo:400: Request processed in 277us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935376.301703:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784935376.301802:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000059438ba0 x1871640291970944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935376.301815:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000059438ba0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640291970944:0@lo:400: 00000100:00100000:2.0:1784935376.301822:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001d9658b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291970816:0@lo:400: 00010000:00010000:3.0:1784935377.005176:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784935377.791070:0:7454:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784935377.791075:0:7454:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1784935377.791076:0:7454:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784935377.791180:0:7454:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000278794cd 00000020:01000004:2.0:1784935377.791194:0:7454:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1784935377.791204:0:7454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784935377.791217:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000c9289a5e) 00000020:00000080:2.0:1784935377.791231:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784935377.870223:0:7454:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1784935377.870598:0:7454:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1784935377.884638:0:7454:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784935377.884946:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1784935377.884956:0:7454:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784935377.884969:0:7454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b1614f 00000020:01000004:0.0:1784935377.884976:0:7454:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1784935377.884994:0:7454:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.128@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784935377.884997:0:7454:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784935377.885003:0:7454:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1784935377.885030:0:7454:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1784935377.885034:0:7454:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.128@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1784935377.913397:0:7454:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.128@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784935377.915544:0:7454:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.128@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1784935377.915554:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784935377.915563:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784935377.915564:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935377.915565:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784935377.915566:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935377.915567:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935377.915569:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784935377.915570:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784935377.915571:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784935377.915573:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935377.915574:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784935377.915578:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1784935377.915581:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784935377.915582:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784935377.915583:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935377.915584:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784935377.915585:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935377.915586:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935377.915587:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784935377.915588:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784935377.915589:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784935377.915590:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935377.915591:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784935377.915635:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1784935377.915654:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f102a458 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291971072:0@lo:253: 00000100:00100000:0.0:1784935377.915722:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935377.915771:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ca23fccb going to sleep for 11 seconds 00000100:00100000:3.0:1784935377.916684:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291971072 00000100:00100000:3.0:1784935377.916693:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291971072 00000100:00100000:3.0:1784935377.916743:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784935377.916750:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000dc45fdab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:7454:x1871640291971072:12345-0@lo:253: 20000000:01000000:3.0:1784935377.916779:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784935377.916784:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1784935377.916788:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1784935377.916791:0:6517:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1784935377.916829:0:6517:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1784935377.917097:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784935377.917226:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1784935377.917241:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784935377.917256:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1784935377.917275:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1784935377.917289:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1784935377.917343:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1784935377.917352:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1784935377.917364:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1784935377.917369:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1784935377.917382:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1784935377.917387:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1784935377.917397:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1784935377.917411:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1784935377.918691:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1784935377.918708:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.128@tcp (null) (null) (null) 00000040:00080000:3.0:1784935377.918725:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1784935377.918732:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784935377.918748:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1784935377.918755:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.128@tcp (null) (null) 00000040:00080000:3.0:1784935377.918768:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1784935377.918773:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1784935377.918787:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1784935377.918804:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1784935377.918818:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1784935377.918903:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1784935377.918912:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1784935377.918923:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1784935377.919361:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1784935377.919379:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1784935377.919386:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1784935377.919399:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1784935377.919420:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1784935377.919426:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1784935377.919474:0:6517:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1784935377.919482:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1784935377.919857:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1784935377.920149:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1784935377.920168:0:6517:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.128@tcp for mdt 20000000:01000000:0.0:1784935377.920170:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.128@tcp (null) (null) (null) 00000040:00080000:0.0:1784935377.920184:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1784935377.920190:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1784935377.920202:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1784935377.920206:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.128@tcp (null) (null) 00000040:00080000:0.0:1784935377.920220:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1784935377.920226:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1784935377.920238:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1784935377.920264:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1784935377.920314:0:6517:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1784935377.920323:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1784935377.920627:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1784935377.920733:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1784935377.920746:0:6517:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.203.128@tcp for mdt 20000000:01000000:0.0:1784935377.920747:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.128@tcp (null) (null) (null) 00000040:00080000:0.0:1784935377.920759:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1784935377.920764:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784935377.920774:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1784935377.920778:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.128@tcp (null) (null) 00000040:00080000:0.0:1784935377.920788:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1784935377.920793:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1784935377.920803:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1784935377.920819:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1784935377.920833:0:6517:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1784935377.920836:0:6517:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1784935377.920839:0:6517:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1784935377.920882:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784935377.920884:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784935377.921560:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1784935377.921587:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1784935377.921604:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1784935377.921902:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1784935377.922089:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1784935377.922120:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1784935377.922131:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784935377.922132:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784935377.922419:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1784935377.922440:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1784935377.922456:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1784935377.922613:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1784935377.922629:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1784935377.922640:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1784935377.922647:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1784935377.922648:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784935377.922903:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1784935377.922920:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1784935377.923061:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1784935377.923201:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1784935377.923217:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1784935377.923230:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1784935377.923249:0:6517:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1784935377.923252:0:6517:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1784935377.923256:0:6517:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1784935377.923262:0:6517:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1784935377.923557:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1784935377.923667:0:6517:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1784935377.936684:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784935377.936882:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.936912:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002264c15a/0x857e02f4e0b1608b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16084 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.936919:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d2f862a6/0x857e02f4e0b160a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b160a0 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.936924:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bb15c014/0x857e02f4e0b16117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16110 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.936964:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.937003:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bb15c014/0x857e02f4e0b16117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16110 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.937018:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bb15c014/0x857e02f4e0b16117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16110 expref: 12 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935377.937031:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000534ad61d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291971200:0@lo:104: 00000100:00100000:2.0:1784935377.937088:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784935377.937146:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d2f862a6/0x857e02f4e0b160a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b160a0 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.937153:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d2f862a6/0x857e02f4e0b160a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b160a0 expref: 12 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935377.937160:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291971328:0@lo:104: 00000100:00100000:2.0:1784935377.937177:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784935377.937198:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002264c15a/0x857e02f4e0b1608b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16084 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.937206:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002264c15a/0x857e02f4e0b1608b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16084 expref: 12 pid: 6517 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935377.937213:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291971456:0@lo:104: 00000100:00100000:0.0:1784935377.937233:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291971200 00000100:00100000:2.0:1784935377.937236:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935377.937242:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291971200 00000100:00100000:2.0:1784935377.937248:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0344895 going to sleep for 11 seconds 00000100:00100000:0.0:1784935377.937279:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291971328 00000100:00100000:0.0:1784935377.937287:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291971328 00000100:00100000:0.0:1784935377.937297:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291971456 00000100:00100000:0.0:1784935377.937299:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291971456 00000100:00100000:0.0:1784935377.937315:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784935377.937323:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000888f95aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:6517:x1871640291971200:12345-0@lo:104: 00010000:00010000:0.0:1784935377.937334:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.937404:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935377.937410:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000888f95aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:6517:x1871640291971200:12345-0@lo:104: Request processed in 89us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935377.937419:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935377.937439:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000534ad61d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291971200:0@lo:104: 00000100:00100000:0.0:1784935377.937449:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784935377.937470:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000002e1cce08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6517:x1871640291971328:12345-0@lo:104: 00010000:00010000:0.0:1784935377.937477:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937502:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935377.937508:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937517:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000911ef04b already unused, calling callback (00000000de675cc8) 10000000:00010000:3.0:1784935377.937521:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.937523:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935377.937531:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000002e1cce08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6517:x1871640291971328:12345-0@lo:104: Request processed in 74us (353us total) trans 0 rc 0/0 00010000:00010000:3.0:1784935377.937532:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935377.937542:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935377.937550:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:3.0:1784935377.937556:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1784935377.937567:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784935377.937574:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000034608a7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6517:x1871640291971456:12345-0@lo:104: 00010000:00010000:0.0:1784935377.937581:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937589:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937598:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935377.937612:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784935377.937617:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000034608a7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6517:x1871640291971456:12345-0@lo:104: Request processed in 44us (383us total) trans 0 rc 0/0 00010000:00010000:3.0:1784935377.937618:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935377.937626:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1784935377.937645:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16117 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937660:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784935377.937662:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937668:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000038edb7e0 already unused, calling callback (00000000de675cc8) 10000000:00010000:3.0:1784935377.937670:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937676:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935377.937681:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935377.937685:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935377.937697:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937703:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935377.937707:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937713:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: 0000000038edb7e0/0x857e02f4e0b160a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b160a7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937722:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935377.937730:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937735:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a5322a9 already unused, calling callback (00000000de675cc8) 10000000:00010000:3.0:1784935377.937737:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937743:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935377.937749:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935377.937753:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935377.937764:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937770:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935377.937793:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937799:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: 000000007a5322a9/0x857e02f4e0b16084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1608b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.937811:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935377.937812:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935377.937814:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935377.937820:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935377.937841:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000720872ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291971840:0@lo:103: 00000100:00100000:3.0:1784935377.937850:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d7ec316d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291971584:0@lo:103: 00000100:00100000:0.0:1784935377.937877:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935377.937906:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045fb30fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640291971712:0@lo:103: 00000100:00100000:1.0:1784935377.938644:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935377.938784:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291971840 00000100:00100000:3.0:1784935377.938793:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291971840 00000100:00100000:0.0:1784935377.938813:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291971584 00000100:00100000:0.0:1784935377.938819:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291971584 00010000:00010000:3.0:1784935377.938822:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002264c15a/0x857e02f4e0b1608b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16084 expref: 13 pid: 6517 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.938836:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bb15c014/0x857e02f4e0b16117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16110 expref: 14 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935377.939389:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291971328:0@lo:104: 00000100:00100000:2.0:1784935377.939399:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291971456:0@lo:104: 00010000:00010000:2.0:1784935377.939419:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935377.939553:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784935377.939561:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784935377.939567:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000008900c1dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:3649:x1871640291971840:12345-0@lo:103: 00000100:00100000:0.0:1784935377.939573:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000002b90ddec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:3651:x1871640291971584:12345-0@lo:103: 00010000:00010000:3.0:1784935377.939583:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935377.939585:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935377.939592:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002264c15a/0x857e02f4e0b1608b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16084 expref: 14 pid: 6517 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939592:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bb15c014/0x857e02f4e0b16117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16110 expref: 14 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939614:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bb15c014/0x857e02f4e0b16117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16110 expref: 14 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.939626:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002264c15a/0x857e02f4e0b1608b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16084 expref: 14 pid: 6517 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939649:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bb15c014/0x857e02f4e0b16117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16110 expref: 14 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.939654:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002264c15a/0x857e02f4e0b1608b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16084 expref: 14 pid: 6517 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935377.939671:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784935377.939685:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935377.939727:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000008900c1dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:3649:x1871640291971840:12345-0@lo:103: Request processed in 165us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935377.939733:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000002b90ddec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:3651:x1871640291971584:12345-0@lo:103: Request processed in 164us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935377.939737:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784935377.939746:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784935377.939770:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935377.939798:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291971712 00000100:00100000:0.0:1784935377.939804:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291971712 00010000:00010000:0.0:1784935377.939821:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d2f862a6/0x857e02f4e0b160a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b160a0 expref: 11 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935377.939852:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784935377.939858:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000a4e32be4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:3652:x1871640291971712:12345-0@lo:103: 00010000:00010000:0.0:1784935377.939866:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935377.939869:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d2f862a6/0x857e02f4e0b160a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b160a0 expref: 11 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939877:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d2f862a6/0x857e02f4e0b160a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b160a0 expref: 11 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939887:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d2f862a6/0x857e02f4e0b160a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b160a0 expref: 11 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939898:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939905:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939917:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939951:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939957:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939963:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939969:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002df0f6e4 already unused, calling callback (000000000ca663c0) 00010000:00010000:0.0:1784935377.939972:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939979:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.939990:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.940000:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935377.940030:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000a4e32be4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+10:3652:x1871640291971712:12345-0@lo:103: Request processed in 172us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935377.940036:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784935377.941291:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d7ec316d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291971584:0@lo:103: 00000100:00100000:3.0:1784935377.942712:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045fb30fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640291971712:0@lo:103: 00000100:00100000:2.0:1784935377.942834:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000720872ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291971840:0@lo:103: 00010000:00010000:2.0:1784935377.942868:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.942878:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.942884:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002df0f6e4/0x857e02f4e0b16156 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784935377.943051:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1784935377.948076:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000dc45fdab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+9:7454:x1871640291971072:12345-0@lo:253: Request processed in 31319us (32346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935377.948090:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f102a458 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291971072:0@lo:253: 00000100:00100000:2.0:1784935377.948094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 10000000:01000000:0.0:1784935377.948109:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1784935377.948509:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784935377.948512:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784935377.948513:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935377.948528:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1784935377.948529:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935377.948530:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935377.948532:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784935377.948533:0:7454:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784935377.948535:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935377.948537:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784935377.948556:0:7454:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000278794cd from lustre-MDT0001 10000000:01000000:0.0:1784935377.948586:0:7454:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1784935377.948590:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1784935377.948596:0:7454:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d4572a3b380 local copy 10000000:01000000:0.0:1784935377.948600:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784935377.948632:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.948642:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.948650:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935377.948668:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f102a458 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291971968:0@lo:101: 00000100:00100000:0.0:1784935377.948722:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935377.948778:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f2e8174c going to sleep for 11 seconds 00000100:00100000:1.0:1784935377.949037:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291971968 00000100:00100000:1.0:1784935377.949044:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291971968 00000100:00100000:1.0:1784935377.949089:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784935377.949096:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000669be5b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+9:7454:x1871640291971968:12345-0@lo:101: 00010000:00010000:1.0:1784935377.949108:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935377.949122:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006ffdb630/0x857e02f4e0b16164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1615d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935377.949141:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ffdb630/0x857e02f4e0b16164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1615d expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935377.949150:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006ffdb630/0x857e02f4e0b16164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1615d expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935377.949158:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006ffdb630, rc 0) 00000100:00100000:1.0:1784935377.949231:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000669be5b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+10:7454:x1871640291971968:12345-0@lo:101: Request processed in 136us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935377.949237:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784935377.950202:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f102a458 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291971968:0@lo:101: 00010000:00010000:2.0:1784935377.950219:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.950228:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935377.950346:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972096:0@lo:501: 00000100:00100000:2.0:1784935377.950384:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935377.950435:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b8f1d924 going to sleep for 11 seconds 00000100:00100000:0.0:1784935377.953805:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291972096 00000100:00100000:0.0:1784935377.953820:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291972096 00000100:00100000:0.0:1784935377.953900:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784935377.953909:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000050f3254b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+10:7454:x1871640291972096:12345-0@lo:501: 00000100:00100000:0.0:1784935377.954049:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000050f3254b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+10:7454:x1871640291972096:12345-0@lo:501: Request processed in 141us (3664us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784935377.954056:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784935377.954294:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972096:0@lo:501: 10000000:01000000:2.0:1784935377.954318:0:7454:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784935377.954339:0:7454:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784935377.954345:0:7454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.954355:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.954363:0:7454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.954385:0:7454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784935377.954412:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d4570c47800 10000000:01000000:2.0:1784935377.954416:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784935377.954421:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d4572a3b380 10000000:01000000:2.0:1784935377.954423:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1784935377.954426:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8d4572a3b380 from 1 10000000:01000000:2.0:1784935377.954428:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784935377.954455:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 000000002df0f6e4/0x857e02f4e0b1616b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.954472:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 000000002df0f6e4/0x857e02f4e0b1616b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.954480:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 000000002df0f6e4/0x857e02f4e0b1616b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935377.954497:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972224:0@lo:101: 00000100:00100000:2.0:1784935377.954542:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935377.954566:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000001fa0ee3a going to sleep for 11 seconds 00000100:00100000:1.0:1784935377.954691:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291972224 00000100:00100000:1.0:1784935377.954696:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291972224 00000100:00100000:1.0:1784935377.954742:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784935377.954748:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000458050c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+10:7454:x1871640291972224:12345-0@lo:101: 00010000:00010000:1.0:1784935377.954757:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935377.954768:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000805f8b5d/0x857e02f4e0b16172 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1616b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935377.954788:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000805f8b5d/0x857e02f4e0b16172 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1616b expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935377.954796:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000805f8b5d/0x857e02f4e0b16172 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1616b expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935377.954804:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000805f8b5d, rc 0) 00000100:00100000:1.0:1784935377.954833:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000458050c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:7454:x1871640291972224:12345-0@lo:101: Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935377.954839:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1784935377.955030:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935377.955041:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.955048:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000369ee0d8 already unused, calling callback (00000000de675cc8) 10000000:00010000:0.0:1784935377.955050:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.955058:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935377.955063:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935377.955068:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935377.955086:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.955092:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935377.955118:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.955124:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b1615d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x857e02f4e0b16164 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.955140:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935377.955142:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935377.955143:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935377.955150:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784935377.955160:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071cf4499 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291972352:0@lo:103: 00000100:00100000:0.0:1784935377.955189:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935377.955215:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291972352 00000100:00100000:0.0:1784935377.955225:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291972352 00000100:00100000:0.0:1784935377.955256:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784935377.955262:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000233d3a87 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:3649:x1871640291972352:12345-0@lo:103: 00010000:00010000:0.0:1784935377.955270:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935377.955279:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006ffdb630/0x857e02f4e0b16164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b1615d expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.955291:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935377.955318:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000233d3a87 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+10:3649:x1871640291972352:12345-0@lo:103: Request processed in 57us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935377.955325:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784935377.955349:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071cf4499 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291972352:0@lo:103: 00000100:00100000:2.0:1784935377.955659:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972224:0@lo:101: 00010000:00010000:2.0:1784935377.955673:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 000000002df0f6e4/0x857e02f4e0b1616b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16172 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.955681:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 000000002df0f6e4/0x857e02f4e0b1616b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16172 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935377.955697:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784935377.955714:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 000000002df0f6e4/0x857e02f4e0b1616b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16172 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.955720:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 000000002df0f6e4/0x857e02f4e0b1616b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16172 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935377.955728:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d4570c47800 10000000:01000000:2.0:1784935377.955732:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784935377.955736:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8d4570c47800 from 1 10000000:01000000:2.0:1784935377.955739:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784935377.955754:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 000000007994b63d/0x857e02f4e0b16179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.955760:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 000000007994b63d/0x857e02f4e0b16179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.955766:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 000000007994b63d/0x857e02f4e0b16179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935377.955777:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972480:0@lo:101: 00000100:00100000:2.0:1784935377.955808:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935377.955837:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000001fa0ee3a going to sleep for 11 seconds 00000100:00100000:0.0:1784935377.956017:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291972480 00000100:00100000:0.0:1784935377.956023:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291972480 00000100:00100000:0.0:1784935377.956047:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784935377.956052:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000031375c4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+10:7454:x1871640291972480:12345-0@lo:101: 00010000:00010000:0.0:1784935377.956061:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935377.956069:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b4342a20/0x857e02f4e0b16180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16179 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.956084:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4342a20/0x857e02f4e0b16180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16179 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.956092:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b4342a20/0x857e02f4e0b16180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16179 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.956098:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b4342a20, rc 0) 00000100:00100000:0.0:1784935377.956134:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000031375c4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:7454:x1871640291972480:12345-0@lo:101: Request processed in 82us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935377.956148:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784935377.956253:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972480:0@lo:101: 00010000:00010000:2.0:1784935377.956262:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 000000007994b63d/0x857e02f4e0b16179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.956268:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 000000007994b63d/0x857e02f4e0b16179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935377.956277:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784935377.956288:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 000000007994b63d/0x857e02f4e0b16179 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.956294:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 000000007994b63d/0x857e02f4e0b16179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935377.956299:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784935377.956302:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784935377.956306:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d4570c47800 10000000:01000000:2.0:1784935377.956308:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784935377.956311:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1784935377.956313:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784935377.956325:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 00000000adc62a1e/0x857e02f4e0b16187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.956330:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 00000000adc62a1e/0x857e02f4e0b16187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.956336:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 00000000adc62a1e/0x857e02f4e0b16187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935377.956351:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972608:0@lo:101: 00000100:00100000:2.0:1784935377.956373:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935377.956396:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000001fa0ee3a going to sleep for 11 seconds 00000100:00100000:0.0:1784935377.956613:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291972608 00000100:00100000:0.0:1784935377.956618:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291972608 00000100:00100000:0.0:1784935377.956650:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784935377.956656:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000082d34e58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:7454:x1871640291972608:12345-0@lo:101: 00010000:00010000:0.0:1784935377.956663:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935377.956671:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c7683164/0x857e02f4e0b1618e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16187 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.956683:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7683164/0x857e02f4e0b1618e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16187 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.956689:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c7683164/0x857e02f4e0b1618e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16187 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935377.956695:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c7683164, rc 0) 00000100:00100000:0.0:1784935377.956725:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000082d34e58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:7454:x1871640291972608:12345-0@lo:101: Request processed in 70us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935377.956730:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784935377.956818:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972608:0@lo:101: 00010000:00010000:2.0:1784935377.956827:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 00000000adc62a1e/0x857e02f4e0b16187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935377.956834:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 00000000adc62a1e/0x857e02f4e0b16187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935377.957073:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972736:0@lo:501: 00000100:00100000:2.0:1784935377.957097:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935377.957121:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000001fa0ee3a going to sleep for 11 seconds 00000100:00100000:1.0:1784935377.957170:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291972736 00000100:00100000:1.0:1784935377.957175:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291972736 00000100:00100000:1.0:1784935377.957203:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784935377.957208:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ffbdf8b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:7454:x1871640291972736:12345-0@lo:501: 00000100:00100000:1.0:1784935377.957308:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ffbdf8b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:7454:x1871640291972736:12345-0@lo:501: Request processed in 99us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935377.957314:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784935377.957399:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972736:0@lo:501: 00000100:00100000:2.0:1784935377.957423:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972864:0@lo:503: 00000100:00100000:2.0:1784935377.957472:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935377.957490:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000001fa0ee3a going to sleep for 11 seconds 00000100:00100000:1.0:1784935377.957539:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291972864 00000100:00100000:1.0:1784935377.957543:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291972864 00000100:00100000:1.0:1784935377.957573:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784935377.957579:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f71a3f57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:7454:x1871640291972864:12345-0@lo:503: 00000100:00100000:1.0:1784935377.957657:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f71a3f57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:7454:x1871640291972864:12345-0@lo:503: Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935377.957670:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784935377.957756:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046d95afa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972864:0@lo:503: 00000040:00080000:3.0:1784935377.958135:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784935377.958201:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045fb30fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972992:0@lo:502: 00000100:00100000:3.0:1784935377.958235:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935377.958318:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003611034 going to sleep for 11 seconds 00000100:00100000:0.0:1784935377.961953:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291972992 00000100:00100000:0.0:1784935377.961968:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291972992 00000100:00100000:0.0:1784935377.962029:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784935377.962038:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000007ded1068 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:7454:x1871640291972992:12345-0@lo:502: 00000100:00100000:0.0:1784935377.962218:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000007ded1068 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:7454:x1871640291972992:12345-0@lo:502: Request processed in 181us (3983us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935377.962225:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784935377.962425:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045fb30fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291972992:0@lo:502: 00000040:00080000:3.0:1784935377.962691:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784935377.962722:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1784935377.962737:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1784935377.962750:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1784935377.962761:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1784935377.962791:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1784935377.962806:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1784935377.962819:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1784935377.962831:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1784935377.962842:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1784935377.962855:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1784935377.962869:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1784935377.962882:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1784935377.962909:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1784935377.962920:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1784935377.962965:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1784935377.962979:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1784935377.962990:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1784935377.963001:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1784935377.963011:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1784935377.963023:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1784935377.963046:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1784935377.963057:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1784935377.963085:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045fb30fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291973120:0@lo:502: 00000100:00100000:3.0:1784935377.963128:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935377.963159:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003611034 going to sleep for 11 seconds 00000100:00100000:0.0:1784935377.963300:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291973120 00000100:00100000:0.0:1784935377.963306:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291973120 00000100:00100000:0.0:1784935377.963339:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784935377.963344:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003ec3766b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:7454:x1871640291973120:12345-0@lo:502: 00000100:00100000:0.0:1784935377.963419:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003ec3766b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:7454:x1871640291973120:12345-0@lo:502: Request processed in 75us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935377.963426:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784935377.963510:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045fb30fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291973120:0@lo:502: 00000040:00080000:3.0:1784935377.963546:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1784935377.963554:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1784935377.964171:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935377.964181:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935377.964183:0:7466:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1784935377.964189:0:7466:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1784935377.964192:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784935377.964224:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000004811483d) 00000020:00000080:3.0:1784935377.964244:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1784935377.964251:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784935377.964322:0:7466:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784935377.964329:0:7466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b1619c 00000020:00000080:3.0:1784935377.964553:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1784935377.964557:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935377.964561:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935377.964562:0:7466:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1784935377.964565:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935377.964569:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935377.964570:0:7466:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1784935377.964573:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784935377.964579:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000eece1ce3) 00000020:00000080:3.0:1784935377.964590:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1784935377.964594:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784935377.964596:0:7466:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1784935377.964598:0:7466:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1784935377.964603:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784935377.964648:0:7466:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000278794cd from lustre-MDT0001, refs=2 00000020:00000080:3.0:1784935377.964659:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000d08f6950) 00000020:00000080:3.0:1784935377.964668:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1784935377.964753:0:7466:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784935377.964758:0:7466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b161b1 00000020:00000080:3.0:1784935377.964842:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1784935377.964848:0:7466:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784935377.964852:0:7466:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x857e02f4e0b161b8 00080000:01000000:3.0:1784935377.964857:0:7466:0:(osd_handler.c:8933:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784935377.964865:0:7466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b161bf 00080000:10000000:3.0:1784935377.965738:0:7466:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1784935377.965848:0:7466:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1784935378.030819:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935378.078769:0:7466:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1784935378.079069:0:7466:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1784935378.087072:0:7466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1784935378.087830:0:7466:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1784935378.105954:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1784935378.105969:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935378.105977:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935378.105979:0:7466:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1784935378.105983:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935378.105989:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935378.105991:0:7466:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1784935378.105994:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784935378.105999:0:7466:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:00000080:1.0:1784935378.106042:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784935378.106056:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000088c5141a) 00000020:00000080:1.0:1784935378.106077:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1784935378.106082:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784935378.106159:0:7466:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1784935378.106166:0:7466:0:(osd_handler.c:8933:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784935378.106171:0:7466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b161cd 00010000:00080000:1.0:1784935378.106213:0:7466:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004d8b5b8b@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.128@tcp at head 00010000:00010000:1.0:1784935378.107982:0:7466:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1784935378.112115:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784935378.112130:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784935378.112169:0:7466:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784935378.112190:0:7466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b161d4 00000100:00080000:2.0:1784935378.112199:0:7466:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784935378.112204:0:7466:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000004d8b5b8b using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935378.112236:0:7466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ceeadcd1 x1871640291973248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935378.112271:0:7466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1784935378.112321:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935378.112325:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935378.112326:0:7466:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1784935378.112329:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784935378.112332:0:7466:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1784935378.112333:0:7466:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784935378.112334:0:7466:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784935378.112336:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784935378.112338:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935378.112339:0:7466:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784935378.112341:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935378.112346:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935378.112347:0:7466:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1784935378.112350:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784935378.112376:0:7466:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784935378.112388:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935378.112391:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935378.112392:0:7466:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1784935378.112395:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935378.112397:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935378.112398:0:7466:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784935378.112401:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784935378.112403:0:7466:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784935378.112429:0:7466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935378.112432:0:7466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935378.112433:0:7466:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784935378.112436:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1784935378.112691:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640291973248:0@lo:38: 00000100:00100000:3.0:1784935378.112757:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935378.112999:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935378.113009:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e38dc54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640291973376:0@lo:400: 00000100:00100000:1.0:1784935378.113059:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935378.113091:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291973376 00000100:00100000:1.0:1784935378.113099:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291973376 00000100:00100000:2.0:1784935378.113129:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291973248 00000100:00100000:2.0:1784935378.113135:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291973248 00000100:00100000:1.0:1784935378.113144:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784935378.113154:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000007a2f9d42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640291973376:12345-0@lo:400: 00000100:00100000:2.0:1784935378.113165:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784935378.113174:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000045fb30fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1871640291973248:12345-0@lo:38: 00010000:00080000:2.0:1784935378.113202:0:6530:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000100:00100000:1.0:1784935378.113224:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000007a2f9d42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640291973376:12345-0@lo:400: Request processed in 72us (164us total) trans 0 rc 0/0 00000020:00000080:2.0:1784935378.113231:0:6530:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b161db 00000004:00100000:2.0:1784935378.113246:0:6530:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1784935378.113250:0:6530:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1784935378.113536:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784935378.113573:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004e38dc54 x1871640291973376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935378.113585:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e38dc54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640291973376:0@lo:400: 00000020:01000000:0.0:1784935378.114194:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1784935378.114236:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784935378.114260:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 00000000adc62a1e/0x857e02f4e0b16187 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.114271:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 00000000adc62a1e/0x857e02f4e0b16187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935378.114278:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4570c47800 from 1 10000000:01000000:0.0:1784935378.114281:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784935378.114308:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.114314:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.114320:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935378.114331:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071cf4499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291973504:0@lo:101: 00000100:00100000:0.0:1784935378.114362:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.114389:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000009c491278 going to sleep for 11 seconds 00000100:00100000:2.0:1784935378.114400:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291973504 00000100:00100000:2.0:1784935378.114521:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291973504 00000100:00100000:2.0:1784935378.114666:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784935378.114676:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000caf95cc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:7454:x1871640291973504:12345-0@lo:101: 00010000:00010000:2.0:1784935378.114687:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935378.114698:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d8c576a/0x857e02f4e0b161e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b161e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935378.114717:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d8c576a/0x857e02f4e0b161e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b161e2 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935378.114727:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d8c576a/0x857e02f4e0b161e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b161e2 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935378.114735:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d8c576a, rc 0) 00000100:00100000:2.0:1784935378.114769:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000caf95cc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:7454:x1871640291973504:12345-0@lo:101: Request processed in 95us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935378.114774:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784935378.114833:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071cf4499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291973504:0@lo:101: 00010000:00010000:0.0:1784935378.114846:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.114860:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935378.116043:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071cf4499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291973632:0@lo:256: 00000100:00100000:0.0:1784935378.116098:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.116802:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000009c491278 going to sleep for 11 seconds 00000100:00100000:2.0:1784935378.116893:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291973632 00000100:00100000:2.0:1784935378.116901:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291973632 00000100:00100000:2.0:1784935378.116965:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784935378.116974:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005fda4e7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:7454:x1871640291973632:12345-0@lo:256: 20000000:01000000:2.0:1784935378.116994:0:6518:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784935378.117039:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784935378.117048:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1784935378.117557:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005fda4e7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:7454:x1871640291973632:12345-0@lo:256: Request processed in 584us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935378.117565:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784935378.117636:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071cf4499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291973632:0@lo:256: 10000000:01000000:0.0:1784935378.118554:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784935378.118619:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.118631:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935378.118650:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4570c47800 from 1 10000000:01000000:0.0:1784935378.118653:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784935378.118686:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.118693:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.118701:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935378.118719:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071cf4499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291973760:0@lo:101: 00000100:00100000:0.0:1784935378.118759:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.118811:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000009c491278 going to sleep for 11 seconds 00000100:00100000:3.0:1784935378.118952:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291973760 00000100:00100000:3.0:1784935378.118960:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291973760 00000100:00100000:3.0:1784935378.119016:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784935378.119024:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0b158e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:7454:x1871640291973760:12345-0@lo:101: 00010000:00010000:3.0:1784935378.119038:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935378.119050:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002264c15a/0x857e02f4e0b161f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b161f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.119070:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002264c15a/0x857e02f4e0b161f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b161f0 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.119080:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002264c15a/0x857e02f4e0b161f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b161f0 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.119089:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002264c15a, rc 0) 00000100:00100000:3.0:1784935378.119130:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0b158e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:7454:x1871640291973760:12345-0@lo:101: Request processed in 107us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.119137:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784935378.119352:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071cf4499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291973760:0@lo:101: 00010000:00010000:0.0:1784935378.119366:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.119374:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935378.119474:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071cf4499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291973888:0@lo:501: 00000100:00100000:0.0:1784935378.119503:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.119565:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000009c491278 going to sleep for 11 seconds 00000100:00100000:3.0:1784935378.119600:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291973888 00000100:00100000:3.0:1784935378.119605:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291973888 00000100:00100000:3.0:1784935378.119636:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784935378.119642:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000b1781398 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:7454:x1871640291973888:12345-0@lo:501: 00000100:00100000:3.0:1784935378.119740:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000b1781398 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:7454:x1871640291973888:12345-0@lo:501: Request processed in 98us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.119753:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784935378.121028:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071cf4499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291973888:0@lo:501: 00000100:00100000:1.0:1784935378.121080:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e38dc54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974016:0@lo:503: 00000100:00100000:1.0:1784935378.121137:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935378.121215:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c1de2146 going to sleep for 11 seconds 00000100:00100000:3.0:1784935378.121307:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291974016 00000100:00100000:3.0:1784935378.121370:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291974016 00000100:00100000:3.0:1784935378.121413:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784935378.121421:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000087cd653f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:7454:x1871640291974016:12345-0@lo:503: 00000040:00080000:3.0:1784935378.121479:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784935378.121571:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000087cd653f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:7454:x1871640291974016:12345-0@lo:503: Request processed in 150us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.121579:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784935378.121701:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e38dc54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974016:0@lo:503: 00000100:00080000:0.0:1784935378.121813:0:6530:0:(import.c:65:import_set_state_nolock()) 00000000ec24436e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784935378.121875:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000045fb30fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1871640291973248:12345-0@lo:38: Request processed in 8700us (9118us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935378.121887:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935378.122014:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784935378.122023:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1784935378.122030:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784935378.122035:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784935378.122037:0:3648:0:(import.c:65:import_set_state_nolock()) 000000004d8b5b8b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784935378.122057:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640291973248:0@lo:38: 00000100:00100000:3.0:1784935378.122444:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935378.122466:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000534ad61d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640291974144:0@lo:41: 00000100:00100000:3.0:1784935378.122503:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935378.122610:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291974144 00000100:00100000:2.0:1784935378.122616:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291974144 00000100:00100000:2.0:1784935378.122661:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935378.122668:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000005a0fdd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1871640291974144:12345-0@lo:41: 00000004:00000024:2.0:1784935378.122692:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1784935378.122888:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000005a0fdd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1871640291974144:12345-0@lo:41: Request processed in 220us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935378.122895:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:1.0:1784935378.122996:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935378.123051:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1784935378.123131:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935378.124122:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1784935378.124307:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1784935378.124342:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784935378.124364:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.124375:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935378.124422:0:7454:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784935378.124425:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d4570c47800 10000000:01000000:0.0:1784935378.124428:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d4570c47800 10000000:01000000:0.0:1784935378.124432:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784935378.124436:0:7454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4570c47800 from 1 10000000:01000000:0.0:1784935378.124439:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784935378.124492:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 00000000bb15c014/0x857e02f4e0b161fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.124500:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 00000000bb15c014/0x857e02f4e0b161fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.124510:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 00000000bb15c014/0x857e02f4e0b161fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935378.124527:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000324a8b0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974272:0@lo:101: 00000100:00100000:0.0:1784935378.124575:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.124608:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000009c491278 going to sleep for 11 seconds 00000100:00100000:0.0:1784935378.124627:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291974272 00000100:00100000:0.0:1784935378.124632:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291974272 00000100:00100000:0.0:1784935378.124664:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784935378.124671:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000fca9c709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:7454:x1871640291974272:12345-0@lo:101: 00010000:00010000:0.0:1784935378.124683:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935378.124693:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000611ce843/0x857e02f4e0b16205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b161fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.124713:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000611ce843/0x857e02f4e0b16205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b161fe expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.124721:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000611ce843/0x857e02f4e0b16205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b161fe expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.124729:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000611ce843, rc 0) 00000100:00100000:0.0:1784935378.124764:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000fca9c709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7454:x1871640291974272:12345-0@lo:101: Request processed in 94us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935378.124771:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784935378.124824:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000324a8b0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974272:0@lo:101: 00010000:00010000:0.0:1784935378.124835:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 00000000bb15c014/0x857e02f4e0b161fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.124841:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 00000000bb15c014/0x857e02f4e0b161fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935378.124900:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000324a8b0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974400:0@lo:501: 00000100:00100000:0.0:1784935378.124923:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.124962:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000009c491278 going to sleep for 11 seconds 00000100:00100000:0.0:1784935378.124976:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291974400 00000100:00100000:0.0:1784935378.124980:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291974400 00000100:00100000:0.0:1784935378.125001:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784935378.125006:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000895fc83d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7454:x1871640291974400:12345-0@lo:501: 00000100:00100000:0.0:1784935378.125091:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000895fc83d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7454:x1871640291974400:12345-0@lo:501: Request processed in 83us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935378.125097:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784935378.125128:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000324a8b0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974400:0@lo:501: 00000100:00100000:0.0:1784935378.125151:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000324a8b0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974528:0@lo:503: 00000100:00100000:0.0:1784935378.125187:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.125198:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000009c491278 going to sleep for 11 seconds 00000100:00100000:0.0:1784935378.125211:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291974528 00000100:00100000:0.0:1784935378.125215:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291974528 00000100:00100000:0.0:1784935378.125235:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784935378.125239:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c176e95a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7454:x1871640291974528:12345-0@lo:503: 00000100:00100000:0.0:1784935378.125320:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c176e95a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7454:x1871640291974528:12345-0@lo:503: Request processed in 80us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935378.125335:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784935378.125388:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000324a8b0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974528:0@lo:503: 00000040:00080000:0.0:1784935378.125634:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784935378.125685:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000324a8b0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974656:0@lo:502: 00000100:00100000:0.0:1784935378.125721:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.125744:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291974656 00000100:00100000:0.0:1784935378.125748:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291974656 00000100:00100000:0.0:1784935378.125772:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784935378.125778:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c247c657 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7454:x1871640291974656:12345-0@lo:502: 00000100:00100000:0.0:1784935378.125862:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c247c657 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7454:x1871640291974656:12345-0@lo:502: Request processed in 84us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935378.125868:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784935378.125899:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 0000000027cc2937 going to sleep for 11 seconds 00000100:00100000:0.0:1784935378.125912:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000324a8b0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974656:0@lo:502: 00000040:00080000:0.0:1784935378.126128:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784935378.126153:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784935378.126170:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784935378.126185:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784935378.126200:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784935378.126214:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784935378.126229:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784935378.126250:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784935378.126266:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784935378.126279:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784935378.126292:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784935378.126305:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784935378.126316:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784935378.126330:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784935378.126359:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784935378.126374:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784935378.126389:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1784935378.126404:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1784935378.126418:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1784935378.126432:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1784935378.126446:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1784935378.126472:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1784935378.126489:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1784935378.126503:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1784935378.126514:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1784935378.126525:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1784935378.126536:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1784935378.126549:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1784935378.126573:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000324a8b0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974784:0@lo:502: 00000100:00100000:0.0:1784935378.126614:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.126641:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291974784 00000100:00100000:0.0:1784935378.126646:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291974784 00000100:00100000:0.0:1784935378.126671:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784935378.126677:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ea10762b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7454:x1871640291974784:12345-0@lo:502: 00000100:00100000:0.0:1784935378.126735:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ea10762b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7454:x1871640291974784:12345-0@lo:502: Request processed in 59us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935378.126741:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784935378.126769:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 0000000027cc2937 going to sleep for 11 seconds 00000100:00100000:0.0:1784935378.126782:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000324a8b0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291974784:0@lo:502: 00000040:00080000:0.0:1784935378.126816:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1784935378.126822:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1784935378.127131:0:7472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1784935378.127143:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000418c2cec) 00000020:00000080:0.0:1784935378.127161:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000100:00100000:3.0:1784935378.127846:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000534ad61d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640291974144:0@lo:41: 00000020:01000004:1.0:1784935378.128227:0:7472:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000278794cd from lustre-MDT0001, refs=3 00000020:01000004:1.0:1784935378.128233:0:7472:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000278794cd from lustre-MDT0001, refs=3 00000020:01000004:1.0:1784935378.128236:0:7472:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000278794cd 3 00010000:00080000:1.0:1784935378.128266:0:7472:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000031f68a5a@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.128@tcp at head 00010000:00010000:1.0:1784935378.131713:0:7472:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1784935378.131853:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1784935378.131898:0:7472:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784935378.131912:0:7472:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x857e02f4e0b16213 00000100:00080000:1.0:1784935378.131924:0:7472:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784935378.131955:0:7472:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000031f68a5a using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935378.131989:0:7472:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004e38dc54 x1871640291974912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784935378.132021:0:7472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1784935378.133335:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1784935378.133335:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e38dc54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871640291974912:0@lo:38: 00000100:00100000:0.0:1784935378.133405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1784935378.133499:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1784935378.133529:0:7454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784935378.133544:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 00000000bb15c014/0x857e02f4e0b161fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935378.133554:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 00000000bb15c014/0x857e02f4e0b161fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784935378.133606:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784935378.133608:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784935378.133609:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935378.133610:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784935378.133611:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935378.133612:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935378.133613:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784935378.133615:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784935378.133616:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784935378.133617:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935378.133619:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784935378.133622:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1784935378.133625:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784935378.133626:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784935378.133627:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935378.133628:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784935378.133629:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935378.133630:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935378.133631:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784935378.133632:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784935378.133633:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784935378.133633:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935378.133634:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784935378.133652:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1784935378.133664:0:7454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eb7a1ba8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291975040:0@lo:253: 00000100:00100000:0.0:1784935378.133696:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.133719:0:7454:0:(client.c:2702:ptlrpc_set_wait()) set 000000002326827e going to sleep for 11 seconds 00000100:00100000:0.0:1784935378.133741:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291974912 00000100:00100000:0.0:1784935378.133748:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291974912 00000100:00100000:0.0:1784935378.133777:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784935378.133782:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000324a8b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1871640291974912:12345-0@lo:38: 00010000:00080000:0.0:1784935378.133800:0:6525:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:0.0:1784935378.133829:0:6525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x857e02f4e0b1621a 00000004:00100000:0.0:1784935378.133842:0:6525:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784935378.133868:0:6525:0:(import.c:65:import_set_state_nolock()) 000000006f02437c : changing import state from RECOVER to FULL 40000000:00080000:1.0:1784935378.133892:0:7474:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1784935378.133923:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000324a8b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871640291974912:12345-0@lo:38: Request processed in 139us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935378.133952:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784935378.133982:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291975040 00000100:00100000:0.0:1784935378.133985:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291975040 00000100:00100000:0.0:1784935378.134022:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784935378.134028:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000001b908032 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7454:x1871640291975040:12345-0@lo:253: 20000000:01000000:0.0:1784935378.134047:0:6520:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784935378.134058:0:6520:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1784935378.134488:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004e38dc54 x1871640291974912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935378.134498:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784935378.134505:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1784935378.134512:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784935378.134516:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784935378.134518:0:3648:0:(import.c:65:import_set_state_nolock()) 0000000031f68a5a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784935378.134522:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e38dc54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871640291974912:0@lo:38: 00000001:00100000:0.0:1784935378.137389:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1784935378.137498:0:6520:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784935378.137516:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1784935378.138043:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784935378.138050:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784935378.138069:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138088:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002d880ddf/0x857e02f4e0b1613a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16133 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138106:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006d8c576a/0x857e02f4e0b161e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b161e2 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138113:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138152:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006d8c576a/0x857e02f4e0b161e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b161e2 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138166:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006d8c576a/0x857e02f4e0b161e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b161e2 expref: 15 pid: 6517 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935378.138180:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005c784f12 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640291975168:0@lo:104: 00000100:00100000:1.0:1784935378.138237:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000001b908032 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7454:x1871640291975040:12345-0@lo:253: Request processed in 4205us (4536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.138245:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935378.138250:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784935378.138315:0:7454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eb7a1ba8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7454:1871640291975040:0@lo:253: 10000000:01000000:1.0:1784935378.138327:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1784935378.138329:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784935378.138331:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784935378.138332:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935378.138333:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935378.138334:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935378.138335:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935378.138336:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784935378.138338:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784935378.138339:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784935378.138340:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935378.138342:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784935378.138368:0:7454:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1784935378.138481:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002d880ddf/0x857e02f4e0b1613a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16133 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138489:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002d880ddf/0x857e02f4e0b1613a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16133 expref: 14 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935378.138497:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000002f3c3c3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640291975296:0@lo:104: 00000100:00100000:3.0:1784935378.138519:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935378.138542:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e9d3c56b going to sleep for 11 seconds 00000100:00100000:3.0:1784935378.138561:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291975168 00000100:00100000:3.0:1784935378.138567:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291975168 00000100:00100000:3.0:1784935378.138598:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291975296 00000100:00100000:3.0:1784935378.138601:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291975296 00000100:00100000:3.0:1784935378.138616:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784935378.138621:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000179424c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6541:x1871640291975168:12345-0@lo:104: 00010000:00010000:3.0:1784935378.138639:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138684:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784935378.138689:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000179424c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6541:x1871640291975168:12345-0@lo:104: Request processed in 68us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.138695:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784935378.138708:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784935378.138714:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000203948c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6541:x1871640291975296:12345-0@lo:104: 00010000:00010000:3.0:1784935378.138720:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138750:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784935378.138754:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000203948c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6541:x1871640291975296:12345-0@lo:104: Request processed in 42us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.138759:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1784935378.138773:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784935378.138777:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138784:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000369ee0d8 already unused, calling callback (00000000de675cc8) 10000000:00010000:3.0:1784935378.138787:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138793:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935378.138799:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935378.138809:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935378.138835:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138841:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935378.138857:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138862:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: 00000000369ee0d8/0x857e02f4e0b161e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b161e9 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138873:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935378.138875:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138880:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b81dd19c already unused, calling callback (00000000de675cc8) 10000000:00010000:3.0:1784935378.138882:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138887:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935378.138892:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935378.138897:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935378.138907:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138924:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935378.138968:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138974:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: 00000000b81dd19c/0x857e02f4e0b16133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1613a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.138986:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935378.138988:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935378.138989:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935378.138995:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935378.139008:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000089d5a8dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291975424:0@lo:103: 00000100:00100000:3.0:1784935378.139035:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935378.139054:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784935378.139060:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000039774fda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291975552:0@lo:103: 00000100:00100000:3.0:1784935378.139081:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935378.139105:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291975424 00000100:00100000:3.0:1784935378.139109:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291975424 00010000:00010000:3.0:1784935378.139139:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006d8c576a/0x857e02f4e0b161e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b161e2 expref: 15 pid: 6517 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935378.139157:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291975552 00000100:00100000:3.0:1784935378.139160:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291975552 00010000:00010000:3.0:1784935378.139168:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002d880ddf/0x857e02f4e0b1613a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16133 expref: 16 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935378.139179:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784935378.139183:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003de99dd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3649:x1871640291975424:12345-0@lo:103: 00010000:00010000:3.0:1784935378.139192:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935378.139195:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006d8c576a/0x857e02f4e0b161e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b161e2 expref: 16 pid: 6517 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.139215:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006d8c576a/0x857e02f4e0b161e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b161e2 expref: 16 pid: 6517 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.139229:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935378.139835:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003de99dd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3649:x1871640291975424:12345-0@lo:103: Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.139843:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784935378.139858:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784935378.139864:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000004004c4b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:3649:x1871640291975552:12345-0@lo:103: 00010000:00010000:3.0:1784935378.139872:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935378.139876:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002d880ddf/0x857e02f4e0b1613a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16133 expref: 15 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.139884:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002d880ddf/0x857e02f4e0b1613a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16133 expref: 15 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.139895:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.139902:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784935378.140014:0:6510:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004182949s 00010000:00010000:3.0:1784935378.140017:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.140023:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.140028:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.140038:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.140043:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004fb6814f already unused, calling callback (000000000ca663c0) 00010000:00010000:3.0:1784935378.140045:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.140051:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.140058:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.140067:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935378.140093:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000004004c4b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:3649:x1871640291975552:12345-0@lo:103: Request processed in 231us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.140099:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784935378.140159:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000039774fda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291975552:0@lo:103: 00000100:00100000:3.0:1784935378.140167:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000089d5a8dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291975424:0@lo:103: 00010000:00010000:3.0:1784935378.140189:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006d8c576a/0x857e02f4e0b161e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b161e2 expref: 14 pid: 6517 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935378.140197:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005c784f12 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640291975168:0@lo:104: 00010000:00010000:3.0:1784935378.140203:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002d880ddf/0x857e02f4e0b1613a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16133 expref: 13 pid: 6520 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935378.140210:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000002f3c3c3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640291975296:0@lo:104: 00010000:00010000:3.0:1784935378.140227:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.140727:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.140737:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935378.140742:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004fb6814f/0x857e02f4e0b16221 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1784935378.146551:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1784935378.146719:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1784935378.146918:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1784935378.147143:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1784935378.147357:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1784935378.147554:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1784935378.149506:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1784935378.149757:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1784935378.150829:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1784935378.151106:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1784935378.151304:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1784935378.151484:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1784935378.153242:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1784935378.153314:0:7477:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1784935378.153318:0:7477:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1784935378.153640:0:7478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1784935378.153691:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003754c924 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1871640291975680:0@lo:700: 00000040:01000000:1.0:1784935378.153715:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1784935378.153781:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.153832:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set 000000001b002eec going to sleep for 11 seconds 00000100:00100000:1.0:1784935378.153834:0:6532:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291975680 00000100:00100000:1.0:1784935378.153843:0:6532:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291975680 00000100:00100000:1.0:1784935378.153884:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784935378.153892:0:6532:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000522be0c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1871640291975680:12345-0@lo:700: 00000100:00100000:2.0:1784935378.154378:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f5e1737e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1871640291975808:0@lo:1000: 00000100:00100000:2.0:1784935378.154411:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935378.154440:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set 00000000329324ff going to sleep for 11 seconds 00000100:00100000:3.0:1784935378.154501:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291975808 00000100:00100000:3.0:1784935378.154507:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291975808 00000100:00100000:3.0:1784935378.154543:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784935378.154550:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003e1f331c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1871640291975808:12345-0@lo:1000: 00000100:00100000:3.0:1784935378.154627:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003e1f331c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1871640291975808:12345-0@lo:1000: Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935378.154666:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f5e1737e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1871640291975808:0@lo:1000: 00000040:01000000:0.0:1784935378.154694:0:7479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1784935378.154700:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784935378.154884:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe361361 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1871640291975936:0@lo:700: 00000100:00100000:0.0:1784935378.154910:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.154953:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ca23fccb going to sleep for 11 seconds 00000100:00100000:3.0:1784935378.155006:0:6534:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291975936 00000100:00100000:3.0:1784935378.155012:0:6534:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291975936 00000100:00100000:3.0:1784935378.155060:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935378.155067:0:6534:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c87fa7fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7479:x1871640291975936:12345-0@lo:700: 00000100:00100000:3.0:1784935378.155121:0:6534:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c87fa7fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7479:x1871640291975936:12345-0@lo:700: Request processed in 54us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.155129:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784935378.155140:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe361361 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1871640291975936:0@lo:700: 00000100:00100000:2.0:1784935378.155175:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009bed64af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1871640291976064:0@lo:900: 00000100:00100000:2.0:1784935378.155199:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935378.155218:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set 00000000786d74af going to sleep for 11 seconds 00000100:00100000:3.0:1784935378.155252:0:6536:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291976064 00000100:00100000:3.0:1784935378.155258:0:6536:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291976064 00000040:01000000:1.0:1784935378.155289:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1784935378.155292:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935378.155301:0:6536:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c17906aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7479:x1871640291976064:12345-0@lo:900: 00000100:00100000:3.0:1784935378.155355:0:6536:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c17906aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7479:x1871640291976064:12345-0@lo:900: Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.155363:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1784935378.155402:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:2.0:1784935378.155504:0:7479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009bed64af x1871640291976064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784935394 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935378.155514:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009bed64af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1871640291976064:0@lo:900: 00000100:00100000:2.0:1784935378.155652:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009bed64af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1871640291976192:0@lo:1000: 00000100:00100000:2.0:1784935378.155679:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935378.155697:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set 000000005ea02170 going to sleep for 11 seconds 00000100:00100000:3.0:1784935378.155729:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291976192 00000100:00100000:3.0:1784935378.155734:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291976192 00000100:00100000:3.0:1784935378.155765:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784935378.155770:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000a27534d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1871640291976192:12345-0@lo:1000: 00000100:00100000:3.0:1784935378.155897:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000a27534d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1871640291976192:12345-0@lo:1000: Request processed in 126us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.155903:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784935378.156018:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009bed64af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1871640291976192:0@lo:1000: 00000004:00080000:2.0:1784935378.156062:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000786d74af with version 0 00000020:00100000:2.0:1784935378.156076:0:7479:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784935378.156080:0:7479:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009bed64af x1871640291976448/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784935378.156091:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009bed64af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1871640291976448:0@lo:1000: 00000100:00100000:3.0:1784935378.156334:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935378.156352:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set 00000000329324ff going to sleep for 11 seconds 00000100:00100000:2.0:1784935378.156410:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291976448 00000100:00100000:2.0:1784935378.156415:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291976448 00000100:00100000:2.0:1784935378.156440:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784935378.156446:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000002f3c3c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1871640291976448:12345-0@lo:1000: 00000004:00000080:1.0:1784935378.157272:0:7454:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784935378.157325:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1784935378.157801:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935378.159569:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784935378.163727:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784935378.164365:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1784935378.164626:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784935378.164973:0:7454:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1784935378.165641:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000001:00080000:2.0:1784935378.165854:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:0.0:1784935378.166043:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 40000000:02000000:1.0:1784935378.166057:0:6532:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:0.0:1784935378.166345:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1784935378.166485:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1784935378.166637:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1784935378.167101:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1784935378.167429:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1784935378.167710:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000100:00100000:3.0:1784935378.167881:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000002f3c3c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1871640291976448:12345-0@lo:1000: Request processed in 11430us (11543us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784935378.167895:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:0.0:1784935378.168013:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1784935378.168114:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1784935378.168270:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1784935378.168410:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1784935378.168581:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1784935378.168676:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1784935378.168836:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1784935378.168973:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1784935378.169305:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1784935378.169435:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1784935378.169575:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1784935378.169722:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1784935378.169876:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1784935378.170135:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1784935378.170266:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1784935378.170425:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1784935378.170569:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1784935378.170701:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1784935378.170832:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1784935378.170993:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1784935378.171138:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000004:00080000:2.0:1784935378.171250:0:7479:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1784935378.171256:0:7479:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1784935378.171274:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009bed64af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1871640291976448:0@lo:1000: 00100000:10000000:0.0:1784935378.171287:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00000100:00100000:2.0:1784935378.171364:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009bed64af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1871640291976576:0@lo:1000: 00000100:00100000:2.0:1784935378.171430:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:0.0:1784935378.171439:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00000100:00100000:2.0:1784935378.171490:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set 000000009c394ad6 going to sleep for 11 seconds 00000100:00100000:3.0:1784935378.171602:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291976576 00000100:00100000:3.0:1784935378.171609:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291976576 00100000:10000000:0.0:1784935378.171628:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000100:00100000:3.0:1784935378.171660:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784935378.171669:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c1aa1e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1871640291976576:12345-0@lo:1000: 00000100:00100000:3.0:1784935378.171777:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c1aa1e85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1871640291976576:12345-0@lo:1000: Request processed in 99us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935378.171785:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000001:00000004:0.0:1784935378.171802:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1784935378.171825:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009bed64af pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1871640291976576:0@lo:1000: 00000040:00080000:3.0:1784935378.171842:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1784935378.171869:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000007940e3ea with version 1 00000004:00080000:0.0:1784935378.171961:0:7469:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000c2b712d1 version 1 rpc_version 1 00000020:00100000:0.0:1784935378.171978:0:7469:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784935378.171985:0:7469:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000069a68aac x1871640291976832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935378.172001:0:7469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000069a68aac pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7469:1871640291976832:0@lo:1000: 00000100:00100000:0.0:1784935378.172035:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935378.172052:0:7469:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb80eaa7 going to sleep for 11 seconds 00000100:00100000:0.0:1784935378.172066:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291976832 00000100:00100000:0.0:1784935378.172069:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291976832 00000100:00100000:0.0:1784935378.172102:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784935378.172109:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000811e34fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1871640291976832:12345-0@lo:1000: 00000100:00100000:1.0:1784935378.172145:0:6532:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000522be0c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1871640291975680:12345-0@lo:700: Request processed in 18253us (18376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935378.172155:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784935378.172203:0:7478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003754c924 x1871640291975680/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784935394 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935378.172214:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003754c924 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1871640291975680:0@lo:700: 40000000:02000000:1.0:1784935378.172223:0:7478:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000040:00080000:3.0:1784935378.173911:0:7479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784935378.174107:0:7479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:0.0:1784935378.175210:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1784935378.175392:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000811e34fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1871640291976832:12345-0@lo:1000: Request processed in 3280us (3353us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784935378.175406:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1784935378.175634:0:7469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1784935378.175639:0:7469:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1784935378.175657:0:7469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000069a68aac pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7469:1871640291976832:0@lo:1000: 00000001:00080000:0.0:1784935378.177067:0:7454:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784935378.177100:0:7454:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffadd441c73988 00100000:10000000:0.0:1784935378.177108:0:7454:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1784935378.177577:0:7454:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784935378.177610:0:7454:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.128@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784935378.177627:0:7454:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1784935378.177643:0:7454:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1784935378.178681:0:7454:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784935378.178852:0:7454:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1784935378.204354:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935378.210854:0:7478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784935378.210922:0:7478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784935378.210948:0:7478:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1784935379.054103:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935380.079327:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935381.106220:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935382.126096:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784935382.201670:0:7724:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1784935383.030850:0:7776:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784935383.031080:0:7776:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784935383.149167:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935383.469161:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007ecf57d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640291977088:0@lo:400: 00000100:00100000:1.0:1784935383.469224:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935383.469283:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935383.469289:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e00786e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640291976960:0@lo:400: 00000100:00100000:1.0:1784935383.469315:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935383.469348:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291977088 00000100:00100000:1.0:1784935383.469354:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291977088 00000100:00100000:1.0:1784935383.469392:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784935383.469483:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003ddae900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291977216:0@lo:400: 00000100:00100000:3.0:1784935383.469513:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935383.469532:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784935383.469546:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000022ebbbc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640291977344:0@lo:400: 00000100:00100000:3.0:1784935383.469570:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935383.469608:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291977344 00000100:00100000:3.0:1784935383.469612:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291977344 00000100:00100000:1.0:1784935383.469649:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000009a73c3c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640291977088:12345-0@lo:400: 00000100:00100000:1.0:1784935383.469700:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000009a73c3c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640291977088:12345-0@lo:400: Request processed in 54us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935383.469792:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291977216 00000100:00100000:2.0:1784935383.469796:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291977216 00000100:00100000:2.0:1784935383.469840:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784935383.469846:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005c784f12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640291977216:12345-0@lo:400: 00000100:00100000:2.0:1784935383.469895:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005c784f12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640291977216:12345-0@lo:400: Request processed in 49us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935383.469901:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784935383.469954:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000076e384f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640291977472:0@lo:41: 00000100:00100000:2.0:1784935383.469979:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935383.470019:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003ddae900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291977216:0@lo:400: 00000100:00100000:2.0:1784935383.470036:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291977472 00000100:00100000:2.0:1784935383.470039:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291977472 00000100:00100000:2.0:1784935383.470057:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935383.470062:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000029b9fa37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640291977472:12345-0@lo:41: 00000004:00000024:2.0:1784935383.470083:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1784935383.470114:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000029b9fa37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640291977472:12345-0@lo:41: Request processed in 52us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935383.470120:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935383.470146:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000076e384f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640291977472:0@lo:41: 00000100:00100000:0.0:1784935383.471976:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291976960 00000100:00100000:0.0:1784935383.471995:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291976960 00000100:00100000:0.0:1784935383.472038:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784935383.472044:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000001891145b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:3652:x1871640291976960:12345-0@lo:400: 00000100:00100000:0.0:1784935383.472112:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000001891145b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:3652:x1871640291976960:12345-0@lo:400: Request processed in 68us (2797us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935383.472118:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784935383.472178:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e00786e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640291976960:0@lo:400: 00010000:00080000:0.0:1784935383.472192:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007ecf57d3 x1871640291977088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935383.472202:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007ecf57d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640291977088:0@lo:400: 00000100:00100000:3.0:1784935383.473560:0:6526:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784935383.473573:0:6526:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1784935383.474452:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784935383.474483:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784935383.474493:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000089d5a8dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640291977344:12345-0@lo:400: 00000100:00100000:1.0:1784935383.474592:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000089d5a8dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640291977344:12345-0@lo:400: Request processed in 103us (5021us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935383.474598:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1784935383.474663:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000022ebbbc9 x1871640291977344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935383.474677:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000022ebbbc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640291977344:0@lo:400: 00010000:00010000:2.0:1784935384.175398:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935385.198057:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784935385.863681:0:7879:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784935385.863862:0:7879:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1784935386.031330:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784935386.031337:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4570c47800 from 4 10000000:01000000:0.0:1784935386.031343:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784935386.031386:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935386.031398:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935386.031418:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935386.031439:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000069a68aac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291977600:0@lo:101: 00000100:00100000:0.0:1784935386.031503:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935386.031546:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 0000000062b3db2a going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.033229:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291977600 00000100:00100000:1.0:1784935386.033242:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291977600 00000100:00100000:1.0:1784935386.033306:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784935386.033315:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000002d90bb5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:6523:x1871640291977600:12345-0@lo:101: 00010000:00010000:1.0:1784935386.033330:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935386.033346:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006bc8ddbe/0x857e02f4e0b1622f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16228 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.033371:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006bc8ddbe/0x857e02f4e0b1622f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16228 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.033381:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006bc8ddbe/0x857e02f4e0b1622f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16228 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.033419:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006bc8ddbe, rc 0) 00000100:00100000:1.0:1784935386.033486:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000002d90bb5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:6523:x1871640291977600:12345-0@lo:101: Request processed in 172us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.033492:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784935386.033544:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000069a68aac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291977600:0@lo:101: 00010000:00010000:1.0:1784935386.033558:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.033567:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935386.033624:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291977728:0@lo:256: 00000100:00100000:1.0:1784935386.033665:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.033692:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef6c63e6 going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.033705:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291977728 00000100:00100000:1.0:1784935386.033708:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291977728 00000100:00100000:1.0:1784935386.033729:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784935386.033735:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000326088fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:6523:x1871640291977728:12345-0@lo:256: 20000000:01000000:1.0:1784935386.033747:0:6518:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784935386.033761:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784935386.033764:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1784935386.033829:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000326088fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:6523:x1871640291977728:12345-0@lo:256: Request processed in 94us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.033847:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784935386.033882:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291977728:0@lo:256: 10000000:01000000:1.0:1784935386.034133:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784935386.034145:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.034152:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 00000000911ef04b/0x857e02f4e0b16228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935386.034161:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784935386.034163:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4570329000 from 21 10000000:01000000:1.0:1784935386.034166:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784935386.034183:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 000000007f3beecb/0x857e02f4e0b16236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.034189:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 000000007f3beecb/0x857e02f4e0b16236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.034196:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 000000007f3beecb/0x857e02f4e0b16236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935386.034207:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291977856:0@lo:101: 00000100:00100000:1.0:1784935386.034232:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.034295:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef6c63e6 going to sleep for 11 seconds 00000100:00100000:0.0:1784935386.037214:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291977856 00000100:00100000:0.0:1784935386.037236:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291977856 00000100:00100000:0.0:1784935386.037364:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784935386.037373:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000040293863 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:6523:x1871640291977856:12345-0@lo:101: 00010000:00010000:0.0:1784935386.037389:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935386.037415:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000369ee0d8/0x857e02f4e0b1623d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16236 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935386.037442:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000369ee0d8/0x857e02f4e0b1623d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16236 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935386.037453:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000369ee0d8/0x857e02f4e0b1623d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16236 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935386.037462:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000369ee0d8, rc 0) 00000100:00100000:0.0:1784935386.037531:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000040293863 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291977856:12345-0@lo:101: Request processed in 160us (3298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935386.037537:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784935386.037605:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291977856:0@lo:101: 00010000:00010000:1.0:1784935386.037622:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 000000007f3beecb/0x857e02f4e0b16236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.037631:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 000000007f3beecb/0x857e02f4e0b16236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935386.037694:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291977984:0@lo:501: 00000100:00100000:1.0:1784935386.037731:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.037757:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef6c63e6 going to sleep for 11 seconds 00000100:00100000:0.0:1784935386.037791:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291977984 00000100:00100000:0.0:1784935386.037795:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291977984 00000100:00100000:0.0:1784935386.037983:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784935386.037990:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000021a5f117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291977984:12345-0@lo:501: 00000100:00100000:0.0:1784935386.038110:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000021a5f117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291977984:12345-0@lo:501: Request processed in 121us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935386.038117:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784935386.038359:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291977984:0@lo:501: 00000100:00100000:1.0:1784935386.038386:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291978112:0@lo:503: 00000100:00100000:1.0:1784935386.038436:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.038455:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef6c63e6 going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.038467:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291978112 00000100:00100000:1.0:1784935386.038471:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291978112 00000100:00100000:1.0:1784935386.038491:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784935386.038496:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000005f4cd97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291978112:12345-0@lo:503: 00000100:00100000:1.0:1784935386.038580:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000005f4cd97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291978112:12345-0@lo:503: Request processed in 84us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.038587:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784935386.038621:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291978112:0@lo:503: 00000100:00100000:1.0:1784935386.038788:0:7891:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7891:1871640291978240:0@lo:502: 00000100:00100000:1.0:1784935386.038819:0:7891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935386.038912:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291978240 00000100:00100000:0.0:1784935386.038916:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291978240 00000100:00100000:0.0:1784935386.038955:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784935386.038961:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000098b36987 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7891:x1871640291978240:12345-0@lo:502: 00000100:00100000:0.0:1784935386.039029:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000098b36987 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7891:x1871640291978240:12345-0@lo:502: Request processed in 69us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935386.039099:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784935386.039170:0:7891:0:(client.c:2702:ptlrpc_set_wait()) set 000000002aaf232e going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.039182:0:7891:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7891:1871640291978240:0@lo:502: 00000100:00100000:1.0:1784935386.039217:0:7891:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7891:1871640291978368:0@lo:502: 00000100:00100000:1.0:1784935386.039245:0:7891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.039296:0:7891:0:(client.c:2702:ptlrpc_set_wait()) set 0000000095d31239 going to sleep for 11 seconds 00000100:00100000:0.0:1784935386.039324:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291978368 00000100:00100000:0.0:1784935386.039328:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291978368 00000100:00100000:0.0:1784935386.039380:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784935386.039385:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000036236229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7891:x1871640291978368:12345-0@lo:502: 00000100:00100000:0.0:1784935386.039458:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000036236229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:7891:x1871640291978368:12345-0@lo:502: Request processed in 73us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935386.039464:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784935386.039519:0:7891:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7891:1871640291978368:0@lo:502: 00000040:00080000:1.0:1784935386.039539:0:7891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1784935386.039590:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1784935386.039619:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784935386.039627:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 000000007f3beecb/0x857e02f4e0b16236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.039636:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 000000007f3beecb/0x857e02f4e0b16236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935386.039644:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784935386.039646:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4570329000 from 4 10000000:01000000:1.0:1784935386.039648:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784935386.039672:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 00000000e5433ac9/0x857e02f4e0b16244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.039678:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 00000000e5433ac9/0x857e02f4e0b16244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.039685:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 00000000e5433ac9/0x857e02f4e0b16244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935386.039695:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291978496:0@lo:101: 00000100:00100000:1.0:1784935386.039724:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.039737:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 0000000095d31239 going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.039751:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291978496 00000100:00100000:1.0:1784935386.039754:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291978496 00000100:00100000:1.0:1784935386.039779:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784935386.039786:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c3aaf84f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291978496:12345-0@lo:101: 00010000:00010000:1.0:1784935386.039795:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935386.039806:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000caf03414/0x857e02f4e0b1624b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16244 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.039849:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000caf03414/0x857e02f4e0b1624b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16244 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.039859:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000caf03414/0x857e02f4e0b1624b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16244 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.039867:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000caf03414, rc 0) 00000100:00100000:1.0:1784935386.039896:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c3aaf84f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640291978496:12345-0@lo:101: Request processed in 111us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.039902:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784935386.039955:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291978496:0@lo:101: 00010000:00010000:1.0:1784935386.039966:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 00000000e5433ac9/0x857e02f4e0b16244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.039973:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 00000000e5433ac9/0x857e02f4e0b16244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935386.040013:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291978624:0@lo:256: 00000100:00100000:1.0:1784935386.040056:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.040079:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 0000000095d31239 going to sleep for 11 seconds 00000100:00100000:2.0:1784935386.041541:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291978624 00000100:00100000:2.0:1784935386.041553:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291978624 00000100:00100000:2.0:1784935386.041604:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784935386.041611:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000030eeb221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640291978624:12345-0@lo:256: 20000000:01000000:2.0:1784935386.041634:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784935386.041652:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784935386.041655:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1784935386.041763:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000030eeb221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640291978624:12345-0@lo:256: Request processed in 152us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935386.041770:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784935386.044831:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291978624:0@lo:256: 10000000:01000000:1.0:1784935386.045007:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784935386.045015:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 00000000e5433ac9/0x857e02f4e0b16244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.045026:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 00000000e5433ac9/0x857e02f4e0b16244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935386.045040:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784935386.045042:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1784935386.045044:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784935386.045075:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 000000003531ff7b/0x857e02f4e0b16252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.045082:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 000000003531ff7b/0x857e02f4e0b16252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.045090:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 000000003531ff7b/0x857e02f4e0b16252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935386.045105:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291978752:0@lo:101: 00000100:00100000:1.0:1784935386.045154:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.045190:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 0000000095d31239 going to sleep for 11 seconds 00000100:00100000:0.0:1784935386.045488:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291978752 00000100:00100000:0.0:1784935386.045496:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291978752 00000100:00100000:0.0:1784935386.045541:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784935386.045549:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000836c183c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640291978752:12345-0@lo:101: 00010000:00010000:0.0:1784935386.045563:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935386.045574:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f839d4de/0x857e02f4e0b16259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16252 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935386.045595:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f839d4de/0x857e02f4e0b16259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16252 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935386.045604:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f839d4de/0x857e02f4e0b16259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16252 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935386.045611:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f839d4de, rc 0) 00000100:00100000:0.0:1784935386.045647:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000836c183c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291978752:12345-0@lo:101: Request processed in 99us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935386.045652:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784935386.045788:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291978752:0@lo:101: 00010000:00010000:1.0:1784935386.045801:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 000000003531ff7b/0x857e02f4e0b16252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.045809:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 000000003531ff7b/0x857e02f4e0b16252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935386.046340:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291978880:0@lo:501: 00000100:00100000:1.0:1784935386.046378:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.046582:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 0000000095d31239 going to sleep for 11 seconds 00000100:00100000:0.0:1784935386.047156:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291978880 00000100:00100000:0.0:1784935386.047165:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291978880 00000100:00100000:0.0:1784935386.047249:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784935386.047257:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005a30b6fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291978880:12345-0@lo:501: 00000100:00100000:0.0:1784935386.047378:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005a30b6fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291978880:12345-0@lo:501: Request processed in 122us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935386.047386:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784935386.047452:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291978880:0@lo:501: 00000100:00100000:1.0:1784935386.047489:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291979008:0@lo:503: 00000100:00100000:1.0:1784935386.047533:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.047555:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 0000000095d31239 going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.047569:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291979008 00000100:00100000:1.0:1784935386.047572:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291979008 00000100:00100000:1.0:1784935386.047594:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784935386.047599:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000663dbf56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291979008:12345-0@lo:503: 00000100:00100000:1.0:1784935386.047678:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000663dbf56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291979008:12345-0@lo:503: Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.047684:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784935386.047722:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291979008:0@lo:503: 00000100:00100000:1.0:1784935386.047882:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7892:1871640291979136:0@lo:502: 00000100:00100000:1.0:1784935386.047914:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935386.048002:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291979136 00000100:00100000:0.0:1784935386.048006:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291979136 00000100:00100000:0.0:1784935386.048032:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784935386.048038:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000024edf9cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:7892:x1871640291979136:12345-0@lo:502: 00000100:00100000:0.0:1784935386.048105:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000024edf9cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:7892:x1871640291979136:12345-0@lo:502: Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935386.048111:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784935386.048195:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fc3c2faa going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.048209:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7892:1871640291979136:0@lo:502: 00000020:01000000:1.0:1784935386.048228:0:7892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935386.048237:0:7892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935386.048239:0:7892:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1784935386.048245:0:7892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784935386.048248:0:7892:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:00000080:1.0:1784935386.048270:0:7892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784935386.048283:0:7892:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000009925eeee) 00000020:00000080:1.0:1784935386.048301:0:7892:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1784935386.048307:0:7892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784935386.053160:0:7892:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784935386.053171:0:7892:0:(osd_handler.c:8933:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784935386.053183:0:7892:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b16267 00010000:00080000:1.0:1784935386.053219:0:7892:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000019bd645c@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.128@tcp at head 00010000:00010000:1.0:1784935386.057143:0:7892:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1784935386.063360:0:7892:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784935386.063374:0:7892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784935386.063418:0:7892:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784935386.063438:0:7892:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b1626e 00000100:00080000:1.0:1784935386.063447:0:7892:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784935386.063452:0:7892:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000019bd645c using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935386.063485:0:7892:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ce11991e x1871640291979264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784935386.063515:0:7892:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1784935386.063556:0:7892:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1784935386.063678:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935386.063690:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000039774fda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640291979392:0@lo:400: 00000100:00100000:3.0:1784935386.063756:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935386.063805:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a4e32be4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291979520:0@lo:400: 00000100:00100000:3.0:1784935386.063843:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935386.063857:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640291979264:0@lo:38: 00000100:00100000:3.0:1784935386.063873:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784935386.063880:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003de99dd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640291979648:0@lo:400: 00000100:00100000:0.0:1784935386.066061:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291979392 00000100:00100000:0.0:1784935386.066072:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291979392 00000100:00100000:0.0:1784935386.066127:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784935386.066136:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000007b90eaf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640291979392:12345-0@lo:400: 00000100:00100000:2.0:1784935386.066524:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935386.066608:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291979520 00000100:00100000:2.0:1784935386.066612:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291979520 00000100:00100000:2.0:1784935386.066636:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291979264 00000100:00100000:2.0:1784935386.066639:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291979264 00000100:00100000:2.0:1784935386.066652:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784935386.066659:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000007929bda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640291979520:12345-0@lo:400: 00000100:00100000:2.0:1784935386.066714:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000007929bda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640291979520:12345-0@lo:400: Request processed in 56us (2880us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935386.066721:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784935386.066734:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784935386.066738:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000076e384f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1871640291979264:12345-0@lo:38: 00010000:00080000:2.0:1784935386.066758:0:6531:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1784935386.066788:0:6531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b16275 00000004:00100000:2.0:1784935386.066802:0:6531:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1784935386.066807:0:6531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1784935386.072339:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935386.072427:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a4e32be4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291979520:0@lo:400: 00000100:00100000:0.0:1784935386.072859:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000007b90eaf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640291979392:12345-0@lo:400: Request processed in 6722us (9100us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935386.072871:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784935386.072890:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291979648 00000100:00100000:3.0:1784935386.072899:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291979648 00000100:00100000:3.0:1784935386.072970:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784935386.072978:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000009bed64af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640291979648:12345-0@lo:400: 00000100:00100000:3.0:1784935386.073032:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000009bed64af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640291979648:12345-0@lo:400: Request processed in 56us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935386.073039:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1784935386.073082:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003de99dd5 x1871640291979648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935386.073106:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003de99dd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640291979648:0@lo:400: 00010000:00080000:2.0:1784935386.073495:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000039774fda x1871640291979392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935386.073507:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000039774fda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640291979392:0@lo:400: 00000100:00080000:2.0:1784935386.075592:0:7895:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000f5e1737e x1871640291979776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935386.075608:0:7895:0:(client.c:2702:ptlrpc_set_wait()) set 0000000052437120 going to sleep for 0 seconds 00000020:01000000:3.0:1784935386.075712:0:7892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935386.075719:0:7892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935386.075722:0:7892:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1784935386.075726:0:7892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935386.075730:0:7892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935386.075732:0:7892:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784935386.075737:0:7892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784935386.075738:0:7892:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784935386.075764:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003de99dd5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7892:1871640291979904:0@lo:502: 00000100:00100000:3.0:1784935386.075848:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935386.075886:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291979904 00000100:00100000:3.0:1784935386.075893:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291979904 00000100:00100000:3.0:1784935386.075978:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784935386.075986:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000009bda704b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:7892:x1871640291979904:12345-0@lo:502: 00000100:00100000:3.0:1784935386.076105:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000009bda704b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:7892:x1871640291979904:12345-0@lo:502: Request processed in 119us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935386.076113:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784935386.076182:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050a687be going to sleep for 11 seconds 00000100:00100000:3.0:1784935386.076202:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003de99dd5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:7892:1871640291979904:0@lo:502: 00000020:01000000:3.0:1784935386.078080:0:7892:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935386.078093:0:7892:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935386.078095:0:7892:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784935386.078101:0:7892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1784935386.081076:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1784935386.081127:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784935386.081138:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 000000003531ff7b/0x857e02f4e0b16252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.081149:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 000000003531ff7b/0x857e02f4e0b16252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935386.081159:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784935386.081171:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d4572a3b380 from 1 10000000:01000000:2.0:1784935386.081174:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784935386.081209:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 000000001e974246/0x857e02f4e0b1627c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.081226:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 000000001e974246/0x857e02f4e0b1627c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.081235:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 000000001e974246/0x857e02f4e0b1627c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935386.081258:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073b6de5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291980032:0@lo:101: 00000100:00100000:2.0:1784935386.081320:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935386.081370:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 000000007940e3ea going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.081442:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291980032 00000100:00100000:1.0:1784935386.081450:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291980032 00000100:00100000:1.0:1784935386.081504:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784935386.081514:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000081dccce3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291980032:12345-0@lo:101: 00010000:00010000:1.0:1784935386.081528:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935386.081540:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000663bfad/0x857e02f4e0b16283 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1627c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.081564:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000663bfad/0x857e02f4e0b16283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1627c expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.081574:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000663bfad/0x857e02f4e0b16283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1627c expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.081582:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000663bfad, rc 0) 00000100:00100000:1.0:1784935386.081628:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000081dccce3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291980032:12345-0@lo:101: Request processed in 116us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.081634:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784935386.081728:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073b6de5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291980032:0@lo:101: 00010000:00010000:2.0:1784935386.081742:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 000000001e974246/0x857e02f4e0b1627c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.081750:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 000000001e974246/0x857e02f4e0b1627c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935386.081804:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073b6de5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291980160:0@lo:501: 00000100:00100000:2.0:1784935386.081850:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935386.081872:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 000000007940e3ea going to sleep for 11 seconds 00000100:00100000:0.0:1784935386.081891:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291980160 00000100:00100000:0.0:1784935386.081897:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291980160 00000100:00100000:0.0:1784935386.081954:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784935386.081961:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000009cfc74ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291980160:12345-0@lo:501: 00000100:00100000:0.0:1784935386.082057:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000009cfc74ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291980160:12345-0@lo:501: Request processed in 98us (207us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784935386.082064:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784935386.082341:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073b6de5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291980160:0@lo:501: 10000000:01000000:2.0:1784935386.082369:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784935386.082375:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: 000000001e974246/0x857e02f4e0b1627c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.082383:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: 000000001e974246/0x857e02f4e0b1627c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784935386.083750:0:6531:0:(import.c:65:import_set_state_nolock()) 000000006e780eb6 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784935386.083844:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000076e384f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1871640291979264:12345-0@lo:38: Request processed in 17103us (17320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935386.083854:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784935386.083950:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784935386.083959:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784935386.083967:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784935386.083972:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784935386.083975:0:3648:0:(import.c:65:import_set_state_nolock()) 0000000019bd645c lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1784935386.083993:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000052437120): req@00000000f5e1737e x1871640291979776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935386.084018:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce11991e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640291979264:0@lo:38: 00000100:00100000:3.0:1784935386.084095:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935386.084135:0:7895:0:(client.c:2702:ptlrpc_set_wait()) set 0000000052437120 going to sleep for 11 seconds 00000100:00100000:2.0:1784935386.084182:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291979776 00000100:00100000:2.0:1784935386.084189:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291979776 00000100:00100000:2.0:1784935386.084344:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784935386.084353:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003de99dd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7895:x1871640291979776:12345-0@lo:1000: 00000100:00100000:1.0:1784935386.084451:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935386.084462:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003de99dd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7895:x1871640291979776:12345-0@lo:1000: Request processed in 111us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.084470:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a9f0544 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640291980288:0@lo:41: 00000100:00100000:2.0:1784935386.084471:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784935386.084506:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.084549:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291980288 00000100:00100000:1.0:1784935386.084553:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291980288 00000100:00100000:1.0:1784935386.084570:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784935386.084574:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000009de085e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640291980288:12345-0@lo:41: 00000004:00000024:1.0:1784935386.084595:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1784935386.084628:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000009de085e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640291980288:12345-0@lo:41: Request processed in 53us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.084633:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784935386.084660:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a9f0544 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640291980288:0@lo:41: 00000100:00100000:0.0:1784935386.084786:0:7895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f5e1737e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1871640291979776:0@lo:1000: 00000040:01000000:0.0:1784935386.084819:0:7895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784935386.084849:0:7895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a9f0544 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1871640291980416:0@lo:1000: 00000100:00100000:0.0:1784935386.084882:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935386.084906:0:7895:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bc45527e going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.084952:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291980416 00000100:00100000:1.0:1784935386.084957:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291980416 00000100:00100000:1.0:1784935386.084980:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784935386.084985:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000069a68aac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7895:x1871640291980416:12345-0@lo:1000: 00000100:00100000:1.0:1784935386.085084:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000069a68aac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7895:x1871640291980416:12345-0@lo:1000: Request processed in 99us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.085090:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784935386.085185:0:7895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a9f0544 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1871640291980416:0@lo:1000: 00000100:00100000:0.0:1784935386.085219:0:7895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a9f0544 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1871640291980544:0@lo:700: 00000100:00100000:0.0:1784935386.085241:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935386.085264:0:7895:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ff123961 going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.086186:0:6535:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291980544 00000100:00100000:1.0:1784935386.086192:0:6535:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291980544 00000100:00100000:1.0:1784935386.086223:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784935386.086229:0:6535:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003754c924 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7895:x1871640291980544:12345-0@lo:700: 00000100:00100000:1.0:1784935386.086286:0:6535:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003754c924 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7895:x1871640291980544:12345-0@lo:700: Request processed in 57us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.086291:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784935386.086455:0:7895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a9f0544 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1871640291980544:0@lo:700: 00000100:00100000:3.0:1784935386.086637:0:7895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e61bead pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1871640291980672:0@lo:1000: 00000100:00100000:3.0:1784935386.086669:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935386.086697:0:7895:0:(client.c:2702:ptlrpc_set_wait()) set 000000009dc0760f going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.086821:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291980672 00000100:00100000:1.0:1784935386.086825:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291980672 00000100:00100000:1.0:1784935386.086966:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784935386.086973:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000000e8dedb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7895:x1871640291980672:12345-0@lo:1000: 00000100:00100000:1.0:1784935386.087030:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000000e8dedb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7895:x1871640291980672:12345-0@lo:1000: Request processed in 59us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.087037:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784935386.087057:0:7895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e61bead pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1871640291980672:0@lo:1000: 00000004:00080000:0.0:1784935386.087098:0:7895:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000012b3f248 with version 0 00000020:00100000:0.0:1784935386.087110:0:7895:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784935386.087116:0:7895:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000fe361361 x1871640291980928/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935386.087128:0:7895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe361361 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1871640291980928:0@lo:1000: 00000100:00100000:0.0:1784935386.087155:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935386.087166:0:7895:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bc45527e going to sleep for 11 seconds 00000100:00100000:1.0:1784935386.087182:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291980928 00000100:00100000:1.0:1784935386.087186:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291980928 00000100:00100000:1.0:1784935386.087216:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784935386.087221:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000008900c1dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7895:x1871640291980928:12345-0@lo:1000: 00000001:00080000:3.0:1784935386.093292:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1784935386.093306:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784935386.098065:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000008900c1dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7895:x1871640291980928:12345-0@lo:1000: Request processed in 10835us (10901us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784935386.098081:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1784935386.098099:0:7895:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1784935386.098107:0:7895:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1784935386.098123:0:7895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe361361 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1871640291980928:0@lo:1000: 00000100:00100000:0.0:1784935386.098213:0:7895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe361361 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1871640291981056:0@lo:1000: 00000100:00100000:0.0:1784935386.098251:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935386.098288:0:7895:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dc24d4d4 going to sleep for 11 seconds 00000100:00100000:2.0:1784935386.098436:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291981056 00000100:00100000:2.0:1784935386.098449:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291981056 00000100:00100000:2.0:1784935386.098497:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784935386.098504:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000233d3a87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7895:x1871640291981056:12345-0@lo:1000: 00000100:00100000:2.0:1784935386.098579:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000233d3a87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7895:x1871640291981056:12345-0@lo:1000: Request processed in 76us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935386.098585:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784935386.098652:0:7895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe361361 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7895:1871640291981056:0@lo:1000: 00000040:00080000:0.0:1784935386.098668:0:7895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1784935386.098696:0:7895:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000bc45527e with version 1 00000040:00080000:0.0:1784935386.100677:0:7895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784935386.100759:0:7895:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784935386.100763:0:7895:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:2.0:1784935386.100976:0:7893:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000fc3c2faa version 1 rpc_version 1 00000020:00100000:2.0:1784935386.101012:0:7893:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784935386.101020:0:7893:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000073b6de5c x1871640291981312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784935386.101040:0:7893:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073b6de5c pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7893:1871640291981312:0@lo:1000: 00000100:00100000:2.0:1784935386.101099:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935386.101137:0:7893:0:(client.c:2702:ptlrpc_set_wait()) set 000000007940e3ea going to sleep for 11 seconds 00000100:00100000:3.0:1784935386.101215:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291981312 00000100:00100000:3.0:1784935386.101223:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291981312 00000100:00100000:3.0:1784935386.101258:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784935386.101265:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000534ad61d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7893:x1871640291981312:12345-0@lo:1000: 00000001:00080000:2.0:1784935386.110049:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1784935386.110741:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000534ad61d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7893:x1871640291981312:12345-0@lo:1000: Request processed in 9471us (9638us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784935386.110754:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1784935386.110853:0:7893:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1784935386.110859:0:7893:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1784935386.110878:0:7893:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073b6de5c pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7893:1871640291981312:0@lo:1000: 00010000:00010000:2.0:1784935386.227024:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784935386.820573:0:7932:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec114b530 20000000:00000080:3.0:1784935386.820590:0:7932:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d4573f7d000 uarg=0000000000000000 20000000:01000000:3.0:1784935386.820629:0:7932:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784935386.820636:0:7932:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784935386.820641:0:7932:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784935386.820708:0:7932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1784935386.820787:0:7932:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1784935386.825599:0:7932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784935386.827019:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784935386.827212:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1784935386.827238:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1784935386.827257:0:7932:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784935386.827285:0:7932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935386.827304:0:7932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000070594ba8/0x857e02f4e0b16109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16102 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935386.827323:0:7932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002264c15a/0x857e02f4e0b161f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b161f0 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935386.827329:0:7932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935386.827365:0:7932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002264c15a/0x857e02f4e0b161f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b161f0 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935386.827390:0:7932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002264c15a/0x857e02f4e0b161f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b161f0 expref: 17 pid: 6517 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935386.827413:0:7932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e61bead pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1871640291981440:0@lo:104: 00000100:00100000:3.0:1784935386.827765:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784935386.827870:0:7932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000070594ba8/0x857e02f4e0b16109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16102 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935386.827879:0:7932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000070594ba8/0x857e02f4e0b16109 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16102 expref: 17 pid: 6517 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935386.827887:0:7932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000039774fda pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1871640291981568:0@lo:104: 00000100:00100000:3.0:1784935386.827907:0:7932:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fa32b8e5 going to sleep for 11 seconds 00000100:00100000:0.0:1784935386.828013:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784935386.828030:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935386.828066:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291981440 00000100:00100000:0.0:1784935386.828073:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291981440 00000100:00100000:0.0:1784935386.828106:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291981568 00000100:00100000:0.0:1784935386.828109:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291981568 00000100:00100000:0.0:1784935386.828121:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784935386.828128:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ab2d7e41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:7932:x1871640291981440:12345-0@lo:104: 00010000:00010000:0.0:1784935386.828140:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935386.828185:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935386.828190:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ab2d7e41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:7932:x1871640291981440:12345-0@lo:104: Request processed in 63us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935386.828197:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784935386.828227:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784935386.828231:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000fe361361 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:7932:x1871640291981568:12345-0@lo:104: 00010000:00010000:0.0:1784935386.828237:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935386.828275:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784935386.828280:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000fe361361 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:7932:x1871640291981568:12345-0@lo:104: Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935386.828294:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1784935386.828640:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784935386.828646:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.828654:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2f862a6 already unused, calling callback (00000000de675cc8) 10000000:00010000:2.0:1784935386.828657:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.828665:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935386.828681:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935386.828686:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784935386.828730:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.828737:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935386.828751:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.828756:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: 00000000d2f862a6/0x857e02f4e0b161f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b161f7 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.828769:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935386.828771:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.828776:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f0c30ce already unused, calling callback (00000000de675cc8) 10000000:00010000:2.0:1784935386.828777:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.828782:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935386.828787:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935386.828792:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784935386.828808:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.828813:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935386.828826:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.828831:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: 000000006f0c30ce/0x857e02f4e0b16102 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16109 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935386.828842:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935386.828844:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935386.828845:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935386.828850:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935386.828856:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935386.828867:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640291981824:0@lo:103: 00000100:00100000:2.0:1784935386.828897:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935386.828975:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935386.828984:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073b6de5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291981696:0@lo:103: 00000100:00100000:3.0:1784935386.829010:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935386.829491:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291981824 00000100:00100000:1.0:1784935386.829499:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291981824 00010000:00010000:1.0:1784935386.829522:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000070594ba8/0x857e02f4e0b16109 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16102 expref: 18 pid: 6517 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935386.829552:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291981696 00000100:00100000:1.0:1784935386.829556:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291981696 00010000:00010000:1.0:1784935386.829565:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002264c15a/0x857e02f4e0b161f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b161f0 expref: 19 pid: 6517 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935386.829578:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784935386.829584:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000046d95afa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:3650:x1871640291981824:12345-0@lo:103: 00010000:00010000:1.0:1784935386.829594:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935386.829598:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000070594ba8/0x857e02f4e0b16109 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16102 expref: 19 pid: 6517 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829606:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000070594ba8/0x857e02f4e0b16109 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16102 expref: 19 pid: 6517 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829630:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935386.829659:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000046d95afa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:3650:x1871640291981824:12345-0@lo:103: Request processed in 76us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.829666:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784935386.829680:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784935386.829685:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000a4e32be4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:3651:x1871640291981696:12345-0@lo:103: 00010000:00010000:1.0:1784935386.829691:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935386.829695:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002264c15a/0x857e02f4e0b161f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b161f0 expref: 18 pid: 6517 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829702:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002264c15a/0x857e02f4e0b161f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b161f0 expref: 18 pid: 6517 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829722:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829729:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829740:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829746:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829751:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829757:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829767:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000deb70661 already unused, calling callback (000000000ca663c0) 00010000:00010000:1.0:1784935386.829771:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829778:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829785:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.829795:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935386.829819:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000a4e32be4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:3651:x1871640291981696:12345-0@lo:103: Request processed in 135us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935386.829826:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1784935386.829863:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002264c15a/0x857e02f4e0b161f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b161f0 expref: 17 pid: 6517 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935386.829876:0:7932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e61bead pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1871640291981440:0@lo:104: 00010000:00010000:1.0:1784935386.829885:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000070594ba8/0x857e02f4e0b16109 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16102 expref: 16 pid: 6517 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935386.829894:0:7932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000039774fda pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1871640291981568:0@lo:104: 00010000:00010000:1.0:1784935386.829924:0:7932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.830770:0:7932:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.830778:0:7932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935386.830793:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000deb70661/0x857e02f4e0b1628a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935386.833317:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640291981824:0@lo:103: 00000100:00100000:3.0:1784935386.836442:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073b6de5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291981696:0@lo:103: 00010000:00010000:3.0:1784935387.256114:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935388.269324:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935388.593072:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640291981952:0@lo:41: 00000100:00100000:2.0:1784935388.593136:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935388.593205:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291981952 00000100:00100000:2.0:1784935388.593211:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291981952 00000100:00100000:2.0:1784935388.593255:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784935388.593263:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000029453312 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640291981952:12345-0@lo:41: 00000004:00000024:2.0:1784935388.593295:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1784935388.593334:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000029453312 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640291981952:12345-0@lo:41: Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935388.593340:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784935388.593402:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640291981952:0@lo:41: 00010000:00010000:3.0:1784935389.293122:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935390.320732:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935391.151746:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784935391.151769:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eb7a1ba8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640291982080:0@lo:41: 00000100:00100000:0.0:1784935391.151831:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935391.151889:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291982080 00000100:00100000:0.0:1784935391.151896:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291982080 00000100:00100000:0.0:1784935391.151959:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784935391.151967:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000071cf4499 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640291982080:12345-0@lo:41: 00000004:00000024:0.0:1784935391.152004:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1784935391.152048:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000071cf4499 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640291982080:12345-0@lo:41: Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935391.152055:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784935391.152095:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eb7a1ba8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640291982080:0@lo:41: 00000100:00100000:1.0:1784935391.156746:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c2871a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640291982464:0@lo:400: 00000100:00100000:1.0:1784935391.156811:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935391.156845:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784935391.156850:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000056e2f24c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640291982336:0@lo:400: 00000100:00100000:1.0:1784935391.156872:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935391.156899:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291982336 00000100:00100000:1.0:1784935391.156905:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291982336 00000100:00100000:1.0:1784935391.156966:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784935391.156974:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ce11991e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640291982336:12345-0@lo:400: 00000100:00100000:1.0:1784935391.157022:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ce11991e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640291982336:12345-0@lo:400: Request processed in 49us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935391.157029:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784935391.157065:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000056e2f24c x1871640291982336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935391.157078:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000056e2f24c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640291982336:0@lo:400: 00000100:00100000:1.0:1784935391.157099:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291982464 00000100:00100000:1.0:1784935391.157102:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291982464 00000100:00100000:1.0:1784935391.157126:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784935391.157131:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000276ecb55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640291982464:12345-0@lo:400: 00000100:00100000:1.0:1784935391.157164:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000276ecb55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640291982464:12345-0@lo:400: Request processed in 33us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935391.157169:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784935391.157196:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e0845dbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640291982208:0@lo:400: 00000100:00100000:1.0:1784935391.157221:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935391.157244:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935391.157248:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c68a340 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640291982592:0@lo:400: 00000100:00100000:1.0:1784935391.157265:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935391.157285:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291982208 00000100:00100000:1.0:1784935391.157288:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291982208 00000100:00100000:1.0:1784935391.157310:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784935391.157314:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb10015 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3652:x1871640291982208:12345-0@lo:400: 00000100:00100000:1.0:1784935391.157341:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb10015 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3652:x1871640291982208:12345-0@lo:400: Request processed in 27us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935391.157346:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784935391.157367:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291982592 00000100:00100000:1.0:1784935391.157383:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291982592 00000100:00100000:1.0:1784935391.157403:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784935391.157408:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000056e2f24c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640291982592:12345-0@lo:400: 00000100:00100000:1.0:1784935391.157434:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000056e2f24c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640291982592:12345-0@lo:400: Request processed in 26us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935391.157439:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784935391.157466:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c2871a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640291982464:0@lo:400: 00010000:00080000:1.0:1784935391.157486:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003c68a340 x1871640291982592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935391.157494:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c68a340 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640291982592:0@lo:400: 00000100:00100000:1.0:1784935391.157501:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e0845dbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640291982208:0@lo:400: 00010000:00010000:3.0:1784935391.342732:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935392.365250:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935393.389619:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935393.710082:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640291982720:0@lo:41: 00000100:00100000:1.0:1784935393.710158:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935393.710266:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291982720 00000100:00100000:2.0:1784935393.710274:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291982720 00000100:00100000:2.0:1784935393.710332:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784935393.710341:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000e0845dbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640291982720:12345-0@lo:41: 00000004:00000024:2.0:1784935393.710384:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1784935393.710429:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000e0845dbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640291982720:12345-0@lo:41: Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935393.710435:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784935393.710489:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640291982720:0@lo:41: 00010000:00010000:3.0:1784935394.413678:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784935395.219085:0:8430:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784935395.219089:0:8430:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1784935395.219090:0:8430:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1784935395.219229:0:8430:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000eddf62f8 00000020:01000004:2.0:1784935395.219246:0:8430:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1784935395.219258:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784935395.219273:0:8430:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000c5a18730) 00000020:00000080:2.0:1784935395.219288:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 10000000:01000000:3.0:1784935395.246145:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784935395.246153:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4570c47800 from 1 10000000:01000000:3.0:1784935395.246157:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784935395.246195:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: 00000000dd615a1f/0x857e02f4e0b16298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.246207:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: 00000000dd615a1f/0x857e02f4e0b16298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.246215:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: 00000000dd615a1f/0x857e02f4e0b16298 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.246237:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000720872ef pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291982848:0@lo:101: 00000100:00100000:3.0:1784935395.246299:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935395.246358:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2927a8a going to sleep for 11 seconds 00000100:00100000:2.0:1784935395.248374:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291982848 00000100:00100000:2.0:1784935395.248387:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291982848 00000100:00100000:2.0:1784935395.248446:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784935395.248455:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000eec35407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640291982848:12345-0@lo:101: 00010000:00010000:2.0:1784935395.248470:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935395.248486:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd9385e9/0x857e02f4e0b1629f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16298 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.248509:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd9385e9/0x857e02f4e0b1629f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16298 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.248531:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd9385e9/0x857e02f4e0b1629f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16298 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.248538:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd9385e9, rc 0) 00000100:00100000:2.0:1784935395.248603:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000eec35407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291982848:12345-0@lo:101: Request processed in 150us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.248608:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784935395.248664:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000720872ef pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291982848:0@lo:101: 00010000:00010000:2.0:1784935395.248679:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: 00000000dd615a1f/0x857e02f4e0b16298 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.248687:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: 00000000dd615a1f/0x857e02f4e0b16298 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.248753:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291982976:0@lo:501: 00000100:00100000:2.0:1784935395.248780:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.248803:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a776fa86 going to sleep for 11 seconds 00000100:00100000:2.0:1784935395.248814:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291982976 00000100:00100000:2.0:1784935395.248817:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291982976 00000100:00100000:2.0:1784935395.248836:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784935395.248840:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000080a40774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291982976:12345-0@lo:501: 00000100:00100000:2.0:1784935395.248964:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000080a40774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291982976:12345-0@lo:501: Request processed in 123us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.248971:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784935395.248997:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291982976:0@lo:501: 00000100:00100000:2.0:1784935395.249036:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291983104:0@lo:503: 00000100:00100000:2.0:1784935395.249072:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.249087:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a776fa86 going to sleep for 11 seconds 00000100:00100000:2.0:1784935395.249099:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291983104 00000100:00100000:2.0:1784935395.249102:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291983104 00000100:00100000:2.0:1784935395.249125:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784935395.249131:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000002f0d51ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291983104:12345-0@lo:503: 00000100:00100000:2.0:1784935395.249217:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000002f0d51ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291983104:12345-0@lo:503: Request processed in 87us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.249223:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784935395.249688:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ceeadcd1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291983104:0@lo:503: 00000100:00100000:3.0:1784935395.253242:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d7ec316d pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8435:1871640291983232:0@lo:502: 00000100:00100000:3.0:1784935395.253319:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935395.255455:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2fb6a44 going to sleep for 11 seconds 00000100:00100000:2.0:1784935395.257086:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291983232 00000100:00100000:2.0:1784935395.257100:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291983232 00000100:00100000:2.0:1784935395.257166:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784935395.257177:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003c12c74b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:8435:x1871640291983232:12345-0@lo:502: 00000100:00100000:2.0:1784935395.257338:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003c12c74b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:8435:x1871640291983232:12345-0@lo:502: Request processed in 164us (4019us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.257356:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784935395.257635:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d7ec316d pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8435:1871640291983232:0@lo:502: 00000020:01000000:0.0:1784935395.257676:0:8435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784935395.257692:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935395.257695:0:8435:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784935395.257704:0:8435:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4570c47800 00000020:00000080:0.0:1784935395.257707:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784935395.257760:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8435:1871640291983360:0@lo:502: 00000100:00100000:0.0:1784935395.257822:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935395.257858:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454831e240 going to sleep for 11 seconds 00000100:00100000:2.0:1784935395.257877:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291983360 00000100:00100000:2.0:1784935395.257884:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291983360 00000100:00100000:2.0:1784935395.257950:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784935395.257958:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:8435:x1871640291983360:12345-0@lo:502: 00000100:00100000:2.0:1784935395.259228:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:8435:x1871640291983360:12345-0@lo:502: Request processed in 1265us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.259239:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00100000:10000000:1.0:1784935395.263050:0:8430:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1784935395.263106:0:8430:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00000100:00100000:0.0:1784935395.264841:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8435:1871640291983360:0@lo:502: 00000020:01000000:0.0:1784935395.264889:0:8435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935395.264898:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935395.264900:0:8435:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784935395.264915:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1784935395.267904:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784935395.267982:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784935395.267995:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b16298 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.268028:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b16298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935395.268039:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784935395.268042:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4570329000 from 1 10000000:01000000:2.0:1784935395.268045:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784935395.268085:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.268093:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.268103:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.268128:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291983488:0@lo:101: 00000100:00100000:2.0:1784935395.268193:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.268226:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf000 going to sleep for 11 seconds 00000100:00100000:3.0:1784935395.268455:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291983488 00000100:00100000:3.0:1784935395.268464:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291983488 00000100:00100000:3.0:1784935395.268513:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784935395.268522:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291983488:12345-0@lo:101: 00010000:00010000:3.0:1784935395.268536:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935395.268548:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554020800/0x857e02f4e0b162ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b162a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.268584:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554020800/0x857e02f4e0b162ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b162a6 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.268593:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554020800/0x857e02f4e0b162ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b162a6 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.268603:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020800, rc 0) 00000100:00100000:3.0:1784935395.268644:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291983488:12345-0@lo:101: Request processed in 123us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935395.268650:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784935395.268741:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291983488:0@lo:101: 00010000:00010000:2.0:1784935395.268755:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.268763:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.268816:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291983616:0@lo:501: 00000100:00100000:2.0:1784935395.268840:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.268867:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf000 going to sleep for 11 seconds 00000100:00100000:3.0:1784935395.268948:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291983616 00000100:00100000:3.0:1784935395.268953:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291983616 00000100:00100000:3.0:1784935395.268975:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784935395.268981:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291983616:12345-0@lo:501: 00000100:00100000:3.0:1784935395.269085:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291983616:12345-0@lo:501: Request processed in 103us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935395.269092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784935395.269231:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291983616:0@lo:501: 00000100:00100000:2.0:1784935395.269256:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291983744:0@lo:503: 00000100:00100000:2.0:1784935395.269292:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.269308:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf000 going to sleep for 11 seconds 00000100:00100000:3.0:1784935395.269367:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291983744 00000100:00100000:3.0:1784935395.269371:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291983744 00000100:00100000:3.0:1784935395.269402:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784935395.269410:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291983744:12345-0@lo:503: 00000100:00100000:3.0:1784935395.269484:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291983744:12345-0@lo:503: Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935395.269492:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784935395.270821:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291983744:0@lo:503: 00000100:00100000:2.0:1784935395.271179:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8436:1871640291983872:0@lo:502: 00000100:00100000:2.0:1784935395.271236:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.271268:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291983872 00000100:00100000:2.0:1784935395.271274:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291983872 00000100:00100000:2.0:1784935395.271307:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784935395.271314:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:8436:x1871640291983872:12345-0@lo:502: 00000100:00100000:2.0:1784935395.271423:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:8436:x1871640291983872:12345-0@lo:502: Request processed in 108us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.271430:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784935395.271474:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784935395.271487:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8436:1871640291983872:0@lo:502: 00000020:01000000:2.0:1784935395.271508:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935395.271516:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935395.271518:0:8436:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784935395.271525:0:8436:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4570329000 00000020:00000080:2.0:1784935395.271527:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784935395.271546:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8436:1871640291984000:0@lo:502: 00000100:00100000:2.0:1784935395.271579:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.271598:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291984000 00000100:00100000:2.0:1784935395.271602:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291984000 00000100:00100000:2.0:1784935395.271622:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784935395.271627:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:8436:x1871640291984000:12345-0@lo:502: 00000100:00100000:2.0:1784935395.271688:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:8436:x1871640291984000:12345-0@lo:502: Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.271694:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784935395.271723:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784935395.271733:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8436:1871640291984000:0@lo:502: 00000020:01000000:2.0:1784935395.271748:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935395.271752:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935395.271753:0:8436:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784935395.271756:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1784935395.271809:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784935395.271826:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784935395.271835:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.271846:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:01000000:1.0:1784935395.305794:0:8430:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784935395.306057:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1784935395.306070:0:8430:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784935395.306082:0:8430:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x857e02f4e0b162b4 00000020:01000004:1.0:1784935395.306089:0:8430:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1784935395.306113:0:8430:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.128@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784935395.306116:0:8430:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784935395.306122:0:8430:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1784935395.306126:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1784935395.306137:0:8430:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d4566f38000) 00000020:00000080:1.0:1784935395.306146:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1784935395.316838:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784935395.317161:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1784935395.317169:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1784935395.317735:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1784935395.317742:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784935395.318276:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784935395.318285:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1784935395.323286:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935395.323460:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1784935395.323466:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1784935395.329386:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1784935395.329407:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1784935395.383550:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935395.384104:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784935395.384111:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1784935395.387328:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784935395.387350:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1784935395.389150:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784935395.389164:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1784935395.391840:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935395.392322:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1784935395.392329:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1784935395.392916:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1784935395.392924:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:0.0:1784935395.442866:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935395.468379:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784935395.468550:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1784935395.468556:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1784935395.472741:0:8430:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1784935395.472754:0:8430:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1784935395.473332:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1784935395.473375:0:8430:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1784935395.473381:0:8430:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.128@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784935395.501515:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784935395.501550:0:8430:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.128@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1784935395.501554:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784935395.501556:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784935395.501558:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935395.501559:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935395.501561:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935395.501562:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935395.501563:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784935395.501565:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784935395.501566:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784935395.501568:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935395.501569:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784935395.501572:0:8430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1784935395.501575:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784935395.501576:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784935395.501577:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935395.501578:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935395.501579:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935395.501581:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935395.501582:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784935395.501583:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784935395.501584:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784935395.501585:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935395.501586:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784935395.501609:0:8430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784935395.501626:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291984128:0@lo:253: 00000100:00100000:2.0:1784935395.501786:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.501962:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44410de840 going to sleep for 11 seconds 00000100:00100000:3.0:1784935395.503389:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291984128 00000100:00100000:3.0:1784935395.503401:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291984128 00000100:00100000:3.0:1784935395.503494:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784935395.503504:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:8430:x1871640291984128:12345-0@lo:253: 20000000:01000000:3.0:1784935395.503539:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784935395.503543:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1784935395.503549:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1784935395.503553:0:6518:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1784935395.503807:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784935395.504261:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1784935395.504276:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1784935395.504294:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1784935395.504300:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1784935395.504312:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1784935395.504326:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1784935395.504424:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1784935395.504439:0:6518:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.128@tcp 20000000:01000000:3.0:1784935395.504441:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.128@tcp (null) (null) (null) 00000040:00080000:3.0:1784935395.504456:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1784935395.504463:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784935395.504476:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1784935395.504481:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.128@tcp (null) (null) 00000040:00080000:3.0:1784935395.504492:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1784935395.504499:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784935395.504511:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1784935395.504526:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1784935395.504591:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1784935395.504601:0:6518:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.128@tcp 20000000:01000000:3.0:1784935395.504603:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.128@tcp (null) (null) (null) 00000040:00080000:3.0:1784935395.504616:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1784935395.504736:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784935395.504757:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1784935395.504763:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.128@tcp (null) (null) 00000040:00080000:3.0:1784935395.504774:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1784935395.504780:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784935395.504792:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1784935395.504806:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1784935395.505452:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1784935395.505468:0:6518:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.128@tcp 20000000:01000000:3.0:1784935395.505469:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.128@tcp (null) (null) (null) 00000040:00080000:3.0:1784935395.505483:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1784935395.505489:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784935395.505499:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1784935395.505504:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.128@tcp (null) (null) 00000040:00080000:3.0:1784935395.505516:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1784935395.505522:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784935395.505533:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1784935395.505545:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1784935395.505557:0:6518:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784935395.505559:0:6518:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784935395.505563:0:6518:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784935395.505599:0:6518:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784935395.505601:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1784935395.506530:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1784935395.506823:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1784935395.506847:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1784935395.506863:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1784935395.506874:0:6518:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784935395.506876:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784935395.507494:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1784935395.507520:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1784935395.507535:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1784935395.507864:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1784935395.507908:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1784935395.507953:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1784935395.507966:0:6518:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784935395.507969:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784935395.508367:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1784935395.508387:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1784935395.508401:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1784935395.508555:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1784935395.508585:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1784935395.508601:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1784935395.508611:0:6518:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1784935395.508614:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784935395.509434:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1784935395.509468:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1784935395.509484:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1784935395.509661:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1784935395.509698:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1784935395.509714:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:3.0:1784935395.509731:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784935395.509750:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.509765:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4540030400/0x857e02f4e0b1618e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16187 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.509771:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4540030c00/0x857e02f4e0b16205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b161fe expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.509777:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b1623d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16236 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.509783:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16252 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.509789:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1627c expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.509795:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.509829:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b1627c expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.509842:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16283 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b1627c expref: 18 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.509864:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d95180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1871640291984256:0@lo:104: 00000100:00100000:3.0:1784935395.510211:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784935395.510298:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16252 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.510308:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16252 expref: 18 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.510316:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1871640291984384:0@lo:104: 00000100:00100000:3.0:1784935395.510337:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784935395.510419:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b1623d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16236 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.510428:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b1623d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16236 expref: 18 pid: 6518 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.510437:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d96d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1871640291984512:0@lo:104: 00000100:00100000:3.0:1784935395.510456:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935395.510519:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291984256 00000100:00100000:0.0:1784935395.510526:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291984256 00000100:00100000:0.0:1784935395.510560:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291984384 00000100:00100000:0.0:1784935395.510562:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291984384 00000100:00100000:0.0:1784935395.510575:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784935395.510583:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6518:x1871640291984256:12345-0@lo:104: 00010000:00010000:0.0:1784935395.510595:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b1627c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.510829:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935395.510837:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6518:x1871640291984256:12345-0@lo:104: Request processed in 254us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.510844:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784935395.510862:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784935395.510868:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6518:x1871640291984384:12345-0@lo:104: 00010000:00010000:0.0:1784935395.510887:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.510986:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784935395.510993:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b1627c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.511118:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4540030c00/0x857e02f4e0b16205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b161fe expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.511127:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4540030c00/0x857e02f4e0b16205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b161fe expref: 18 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.511136:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1871640291984640:0@lo:104: 00000100:00100000:3.0:1784935395.511171:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784935395.511193:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4540030400/0x857e02f4e0b1618e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16187 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.511211:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4540030400/0x857e02f4e0b1618e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16187 expref: 18 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.511221:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1871640291984768:0@lo:104: 00000100:00100000:3.0:1784935395.511242:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935395.511252:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45729f0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784935395.511272:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d95180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1871640291984256:0@lo:104: 00000100:00100000:3.0:1784935395.511280:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1871640291984384:0@lo:104: 00010000:00010000:2.0:1784935395.511380:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528200 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935395.511385:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b1627c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.511394:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b1627c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935395.511401:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b1627c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935395.511407:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935395.511443:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b1627c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.511450:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935395.511471:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b1627c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.511477:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b1627c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16283 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.511491:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935395.511495:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.511510:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166a200 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935395.511513:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.511519:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935395.511525:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935395.511530:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935395.511544:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.511549:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935395.511554:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16252 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.511560:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16252 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16259 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.511572:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935395.511573:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935395.511576:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935395.511588:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291984896:0@lo:103: 00000100:00100000:2.0:1784935395.511616:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.511639:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935395.511644:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291985024:0@lo:103: 00000100:00100000:2.0:1784935395.511675:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784935395.511801:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1784935395.511808:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6518:x1871640291984384:12345-0@lo:104: Request processed in 941us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.511815:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784935395.511830:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291984512 00000100:00100000:0.0:1784935395.511835:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291984512 00000100:00100000:0.0:1784935395.511852:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291984640 00000100:00100000:0.0:1784935395.511854:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291984640 00000100:00100000:0.0:1784935395.511863:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291984768 00000100:00100000:0.0:1784935395.511865:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291984768 00000100:00100000:0.0:1784935395.511888:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784935395.511894:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:6518:x1871640291984512:12345-0@lo:104: 00010000:00010000:0.0:1784935395.511903:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d454166b000/0x857e02f4e0b16236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.512142:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d96d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1871640291984512:0@lo:104: 00000100:00100000:1.0:1784935395.512220:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291984896 00000100:00100000:1.0:1784935395.512225:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291984896 00010000:00010000:1.0:1784935395.512245:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16283 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1627c expref: 19 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935395.512272:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291985024 00000100:00100000:1.0:1784935395.512275:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291985024 00010000:00010000:1.0:1784935395.512300:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16252 expref: 20 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935395.512314:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784935395.512319:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3649:x1871640291984896:12345-0@lo:103: 00010000:00010000:1.0:1784935395.512328:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935395.512333:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16283 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1627c expref: 20 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.512363:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b1627c expref: 20 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.512376:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16283 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b1627c expref: 20 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.512391:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935395.512424:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:3649:x1871640291984896:12345-0@lo:103: Request processed in 105us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.512430:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784935395.512444:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784935395.512450:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:3649:x1871640291985024:12345-0@lo:103: 00010000:00010000:1.0:1784935395.512467:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935395.512473:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16252 expref: 18 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.512481:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16252 expref: 18 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.512491:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16252 expref: 18 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.512501:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935395.512524:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:3649:x1871640291985024:12345-0@lo:103: Request processed in 74us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.512530:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784935395.512556:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291985024:0@lo:103: 00000100:00100000:1.0:1784935395.512563:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291984896:0@lo:103: 00010000:00010000:3.0:1784935395.512683:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935395.512690:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166b000/0x857e02f4e0b16236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.512697:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166b000 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:3.0:1784935395.512701:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b000/0x857e02f4e0b16236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.512709:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166b000/0x857e02f4e0b16236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935395.512715:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b000/0x857e02f4e0b16236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935395.512721:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935395.512750:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166b000/0x857e02f4e0b16236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.512756:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935395.512770:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166b000/0x857e02f4e0b16236 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.512783:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166b000/0x857e02f4e0b16236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1623d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.512793:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935395.512795:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935395.512797:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935395.512807:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291985152:0@lo:103: 00000100:00100000:3.0:1784935395.512836:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.513115:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291985152 00000100:00100000:1.0:1784935395.513121:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291985152 00010000:00010000:1.0:1784935395.513138:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b1623d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16236 expref: 17 pid: 6518 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935395.513165:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784935395.513171:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:3651:x1871640291985152:12345-0@lo:103: 00010000:00010000:1.0:1784935395.513179:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935395.513183:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b1623d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16236 expref: 17 pid: 6518 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.513191:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b1623d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16236 expref: 17 pid: 6518 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.513200:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b1623d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16236 expref: 17 pid: 6518 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.513210:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935395.513247:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3651:x1871640291985152:12345-0@lo:103: Request processed in 76us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.513253:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784935395.513356:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291985152:0@lo:103: 00010000:00010000:0.0:1784935395.513475:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1784935395.513483:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:6518:x1871640291984512:12345-0@lo:104: Request processed in 1589us (3025us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.513489:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784935395.513505:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784935395.513511:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6518:x1871640291984640:12345-0@lo:104: 00010000:00010000:0.0:1784935395.513520:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b161fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.513627:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935395.513641:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b161fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.513648:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030600 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935395.513651:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b161fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.513658:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b161fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935395.513663:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b161fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935395.513668:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935395.513696:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b161fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.513702:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935395.513714:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b161fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.513721:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b161fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16205 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.513732:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935395.513733:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935395.513735:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935395.513751:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640291985280:0@lo:103: 00000100:00100000:2.0:1784935395.513779:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.513811:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291985280 00000100:00100000:2.0:1784935395.513815:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291985280 00010000:00010000:2.0:1784935395.513829:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4540030c00/0x857e02f4e0b16205 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b161fe expref: 16 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.513846:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784935395.513852:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3652:x1871640291985280:12345-0@lo:103: 00010000:00010000:2.0:1784935395.513860:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935395.513864:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4540030c00/0x857e02f4e0b16205 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b161fe expref: 16 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.513883:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4540030c00/0x857e02f4e0b16205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b161fe expref: 16 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.513893:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935395.513920:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3652:x1871640291985280:12345-0@lo:103: Request processed in 68us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.513960:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784935395.514012:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640291985280:0@lo:103: 00010000:00010000:3.0:1784935395.514271:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540030c00/0x857e02f4e0b16205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b161fe expref: 15 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.514281:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1871640291984640:0@lo:104: 00010000:00010000:0.0:1784935395.514416:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1784935395.514431:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6518:x1871640291984640:12345-0@lo:104: Request processed in 920us (3259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.514438:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784935395.514455:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784935395.514463:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6518:x1871640291984768:12345-0@lo:104: 00010000:00010000:0.0:1784935395.514472:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b16187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.514553:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1871640291984768:0@lo:104: 00010000:00010000:2.0:1784935395.514578:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.514611:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935395.514617:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b16187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.514624:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529000 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:3.0:1784935395.514626:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b16187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.514732:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b16187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935395.514739:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b16187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935395.514756:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935395.514817:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b16187 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.514825:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935395.514848:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b16187 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.514854:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b16187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1618e expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.514967:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291985408:0@lo:103: 00000100:00100000:2.0:1784935395.515010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.515050:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291985408 00000100:00100000:2.0:1784935395.515061:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291985408 00010000:00010000:2.0:1784935395.515078:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4540030400/0x857e02f4e0b1618e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16187 expref: 15 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.515099:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784935395.515106:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45729c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:3649:x1871640291985408:12345-0@lo:103: 00010000:00010000:2.0:1784935395.515114:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935395.515118:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4540030400/0x857e02f4e0b1618e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16187 expref: 15 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515127:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4540030400/0x857e02f4e0b1618e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16187 expref: 15 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515138:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540030400/0x857e02f4e0b1618e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16187 expref: 15 pid: 6517 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515150:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515158:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515171:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515179:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515185:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515190:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515201:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935395.515205:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515213:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515226:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515234:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935395.515262:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45729c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:3649:x1871640291985408:12345-0@lo:103: Request processed in 157us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.515268:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784935395.515319:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291985408:0@lo:103: 00010000:00010000:2.0:1784935395.515336:0:6518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515357:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.515363:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554020000/0x857e02f4e0b162c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784935395.515376:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1784935395.515764:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935395.515770:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935395.515772:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935395.515822:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1784935395.515831:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6518:x1871640291984768:12345-0@lo:104: Request processed in 1368us (4587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.515840:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1784935395.516136:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935395.521537:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:8430:x1871640291984128:12345-0@lo:253: Request processed in 18025us (19741us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.521552:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784935395.521710:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291984128:0@lo:253: 10000000:01000000:3.0:1784935395.521724:0:8430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784935395.521727:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784935395.521728:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784935395.521730:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784935395.521731:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1784935395.521732:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784935395.521733:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784935395.521734:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784935395.521735:0:8430:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784935395.521737:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784935395.521738:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784935395.521758:0:8430:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d457b962000 from lustre-OST0000 10000000:01000000:3.0:1784935395.521787:0:8430:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1784935395.521790:0:8430:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784935395.521797:0:8430:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d4572a3b380 local copy 10000000:01000000:3.0:1784935395.521802:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784935395.521842:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.521853:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.521863:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.522155:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291985536:0@lo:101: 00000100:00100000:3.0:1784935395.522198:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935395.522266:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45729f06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935395.522304:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291985536 00000100:00100000:2.0:1784935395.522309:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291985536 00000100:00100000:2.0:1784935395.522464:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784935395.522473:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:8430:x1871640291985536:12345-0@lo:101: 00010000:00010000:2.0:1784935395.522485:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935395.522500:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b162d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b162c9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.522522:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b162d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b162c9 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.522532:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b162d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b162c9 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.522541:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529e00, rc 0) 00000100:00100000:2.0:1784935395.522583:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:8430:x1871640291985536:12345-0@lo:101: Request processed in 110us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.522589:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784935395.522655:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291985536:0@lo:101: 00010000:00010000:3.0:1784935395.522670:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.522679:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.522765:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291985664:0@lo:501: 00000100:00100000:3.0:1784935395.522790:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935395.523019:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45729f06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935395.523183:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291985664 00000100:00100000:0.0:1784935395.523188:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291985664 00000100:00100000:0.0:1784935395.523214:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784935395.523221:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:8430:x1871640291985664:12345-0@lo:501: 00000100:00100000:0.0:1784935395.523290:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:8430:x1871640291985664:12345-0@lo:501: Request processed in 69us (499us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784935395.523297:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784935395.523429:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291985664:0@lo:501: 10000000:01000000:3.0:1784935395.523442:0:8430:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784935395.523458:0:8430:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784935395.523464:0:8430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.523472:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.523489:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.523514:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784935395.523536:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d457b962000 10000000:01000000:3.0:1784935395.523541:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784935395.523546:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784935395.523548:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784935395.523551:0:8430:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784935395.523554:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784935395.523572:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.523579:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.523588:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.523600:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291985792:0@lo:101: 00000100:00100000:3.0:1784935395.523623:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784935395.523766:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935395.523773:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.523781:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021600 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935395.523784:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.523792:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935395.523806:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935395.523811:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935395.523829:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.523835:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935395.523854:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.523861:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b162c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x857e02f4e0b162d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.523957:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935395.523960:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935395.523962:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935395.523973:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640291985920:0@lo:103: 00000100:00100000:0.0:1784935395.524085:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935395.524185:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45729f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935395.524227:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291985792 00000100:00100000:0.0:1784935395.524232:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291985792 00000100:00100000:0.0:1784935395.524255:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784935395.524261:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:8430:x1871640291985792:12345-0@lo:101: 00010000:00010000:0.0:1784935395.524270:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935395.524281:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4540031000/0x857e02f4e0b162de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b162d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.524299:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4540031000/0x857e02f4e0b162de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b162d7 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.524389:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4540031000/0x857e02f4e0b162de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b162d7 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.524396:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540031000, rc 0) 00000100:00100000:0.0:1784935395.524436:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291985792:12345-0@lo:101: Request processed in 175us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.524602:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784935395.524775:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291985792:0@lo:101: 00010000:00010000:3.0:1784935395.524789:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.524796:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.524889:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986048:0@lo:501: 00000100:00100000:3.0:1784935395.524918:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935395.524951:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45729f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935395.525112:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291986048 00000100:00100000:0.0:1784935395.525117:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291986048 00000100:00100000:0.0:1784935395.525138:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784935395.525144:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986048:12345-0@lo:501: 00000100:00100000:0.0:1784935395.525243:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986048:12345-0@lo:501: Request processed in 98us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.525250:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784935395.525466:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986048:0@lo:501: 00000100:00100000:3.0:1784935395.525495:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986176:0@lo:503: 00000100:00100000:3.0:1784935395.525535:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935395.525563:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45729f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935395.525604:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291986176 00000100:00100000:0.0:1784935395.525609:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291986176 00000100:00100000:0.0:1784935395.525646:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784935395.525652:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986176:12345-0@lo:503: 00000100:00100000:0.0:1784935395.525739:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986176:12345-0@lo:503: Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.525745:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784935395.525844:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986176:0@lo:503: 00000040:00080000:3.0:1784935395.526236:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784935395.526303:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986304:0@lo:502: 00000100:00100000:3.0:1784935395.526363:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935395.526381:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45729f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935395.526506:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291986304 00000100:00100000:0.0:1784935395.526511:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291986304 00000100:00100000:0.0:1784935395.526532:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784935395.526538:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986304:12345-0@lo:502: 00000100:00100000:0.0:1784935395.526623:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986304:12345-0@lo:502: Request processed in 84us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.526646:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784935395.526805:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986304:0@lo:502: 00000040:00080000:3.0:1784935395.527207:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784935395.527235:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784935395.527251:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784935395.527263:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784935395.527275:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784935395.527287:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784935395.527384:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986432:0@lo:502: 00000100:00100000:3.0:1784935395.527428:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935395.527461:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45729f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935395.527563:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291986432 00000100:00100000:0.0:1784935395.527569:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291986432 00000100:00100000:0.0:1784935395.527607:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784935395.527614:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986432:12345-0@lo:502: 00000100:00100000:0.0:1784935395.528179:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986432:12345-0@lo:502: Request processed in 564us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.528187:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784935395.528266:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986432:0@lo:502: 00000040:00080000:3.0:1784935395.528396:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784935395.528413:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:0.0:1784935395.529047:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291985920 00000100:00100000:0.0:1784935395.529055:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291985920 00000100:00100000:0.0:1784935395.529101:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784935395.529108:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:3650:x1871640291985920:12345-0@lo:103: 00010000:00010000:0.0:1784935395.529120:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935395.529138:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b162d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b162c9 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.529152:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935395.529197:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:3650:x1871640291985920:12345-0@lo:103: Request processed in 89us (5112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.529203:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784935395.529230:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640291985920:0@lo:103: 00000020:01000000:3.0:1784935395.529438:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784935395.529446:0:8455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1784935395.529454:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935395.529456:0:8455:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784935395.529462:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784935395.529477:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d457b9799c0) 00000020:00000080:3.0:1784935395.529499:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784935395.529505:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784935395.529570:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457b962000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784935395.529577:0:8455:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784935395.529582:0:8455:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x857e02f4e0b162ec 00010000:00010000:3.0:1784935395.552535:0:8455:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1784935395.552819:0:8455:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1784935395.559473:0:8455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784935395.560678:0:8455:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1784935395.568152:0:8455:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1784935395.568426:0:8455:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1784935395.583421:0:8455:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1784935395.585734:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1784935395.585747:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935395.585753:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935395.585756:0:8455:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1784935395.585759:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935395.585762:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935395.585764:0:8455:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784935395.585767:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784935395.585769:0:8455:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784935395.585791:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935395.585794:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935395.585795:0:8455:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784935395.585799:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1784935395.586011:0:8430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1784935395.586038:0:8430:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784935395.586059:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.586071:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935395.586086:0:8430:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457b962000 from 1 10000000:01000000:0.0:1784935395.586089:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784935395.586122:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.586132:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935395.586143:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935395.586164:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986560:0@lo:101: 00000100:00100000:0.0:1784935395.586225:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935395.586271:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784935395.587734:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291986560 00000100:00100000:3.0:1784935395.587752:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291986560 00000100:00100000:3.0:1784935395.587807:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784935395.587816:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:8430:x1871640291986560:12345-0@lo:101: 00010000:00010000:3.0:1784935395.587833:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935395.587851:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554021000/0x857e02f4e0b162fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b162f3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.587878:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554021000/0x857e02f4e0b162fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b162f3 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.587889:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554021000/0x857e02f4e0b162fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b162f3 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.587897:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021000, rc 0) 00000100:00100000:3.0:1784935395.587996:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986560:12345-0@lo:101: Request processed in 181us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935395.588013:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784935395.588139:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986560:0@lo:101: 00010000:00010000:1.0:1784935395.588159:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.588167:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935395.588257:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986688:0@lo:501: 00000100:00100000:1.0:1784935395.588293:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.588331:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4560e7a600 going to sleep for 11 seconds 00000100:00100000:1.0:1784935395.588357:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291986688 00000100:00100000:1.0:1784935395.588361:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291986688 00000100:00100000:1.0:1784935395.588389:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784935395.588396:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986688:12345-0@lo:501: 00000100:00100000:1.0:1784935395.588483:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986688:12345-0@lo:501: Request processed in 87us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.588490:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784935395.588521:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986688:0@lo:501: 00000100:00100000:1.0:1784935395.588546:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986816:0@lo:503: 00000100:00100000:1.0:1784935395.588583:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.588596:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e3a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1784935395.588608:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291986816 00000100:00100000:1.0:1784935395.588612:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291986816 00000100:00100000:1.0:1784935395.588644:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784935395.588650:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986816:12345-0@lo:503: 00000100:00100000:1.0:1784935395.588731:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986816:12345-0@lo:503: Request processed in 80us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.588738:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784935395.588779:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986816:0@lo:503: 00000040:00080000:1.0:1784935395.589018:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784935395.589083:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986944:0@lo:502: 00000100:00100000:1.0:1784935395.589115:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.589130:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e3a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1784935395.589144:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291986944 00000100:00100000:1.0:1784935395.589153:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291986944 00000100:00100000:1.0:1784935395.589171:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784935395.589177:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986944:12345-0@lo:502: 00000100:00100000:1.0:1784935395.589254:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291986944:12345-0@lo:502: Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.589261:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784935395.589302:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291986944:0@lo:502: 00000040:00080000:1.0:1784935395.589481:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1784935395.589506:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1784935395.589525:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987072:0@lo:502: 00000100:00100000:1.0:1784935395.589556:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.589569:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549464d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784935395.589582:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291987072 00000100:00100000:1.0:1784935395.589585:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291987072 00000100:00100000:1.0:1784935395.589603:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784935395.589608:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291987072:12345-0@lo:502: 00000100:00100000:1.0:1784935395.589668:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291987072:12345-0@lo:502: Request processed in 59us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.589674:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784935395.589710:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987072:0@lo:502: 00000040:00080000:1.0:1784935395.589744:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1784935395.589751:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1784935395.590016:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935395.590024:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935395.590027:0:8458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784935395.590033:0:8458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d457b962000 00000020:00000080:1.0:1784935395.590035:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935395.590054:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935395.590056:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935395.590057:0:8458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784935395.590060:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784935395.590091:0:8430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784935395.590110:0:8430:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784935395.590122:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.590132:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935395.590169:0:8430:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784935395.590172:0:8430:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d457b962000 10000000:01000000:1.0:1784935395.590175:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d457b962000 10000000:01000000:1.0:1784935395.590178:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784935395.590183:0:8430:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d457b962000 from 1 10000000:01000000:1.0:1784935395.590185:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784935395.590206:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.590214:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.590222:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935395.590234:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987200:0@lo:101: 00000100:00100000:1.0:1784935395.590261:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.590274:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549464000 going to sleep for 11 seconds 00000100:00100000:1.0:1784935395.590294:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291987200 00000100:00100000:1.0:1784935395.590302:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291987200 00000100:00100000:1.0:1784935395.590325:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784935395.590332:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8430:x1871640291987200:12345-0@lo:101: 00010000:00010000:1.0:1784935395.590351:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935395.590363:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d454166b000/0x857e02f4e0b16308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16301 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.590380:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d454166b000/0x857e02f4e0b16308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16301 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.590389:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d454166b000/0x857e02f4e0b16308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16301 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.590396:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d454166b000, rc 0) 00000100:00100000:1.0:1784935395.590426:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:8430:x1871640291987200:12345-0@lo:101: Request processed in 95us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.590431:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784935395.590461:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987200:0@lo:101: 00010000:00010000:1.0:1784935395.590472:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.590479:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935395.590528:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987328:0@lo:501: 00000100:00100000:1.0:1784935395.590551:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.590563:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549464000 going to sleep for 11 seconds 00000100:00100000:1.0:1784935395.590580:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291987328 00000100:00100000:1.0:1784935395.590583:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291987328 00000100:00100000:1.0:1784935395.590606:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784935395.590610:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:8430:x1871640291987328:12345-0@lo:501: 00000100:00100000:1.0:1784935395.590682:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:8430:x1871640291987328:12345-0@lo:501: Request processed in 70us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.590689:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784935395.590718:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987328:0@lo:501: 00000100:00100000:1.0:1784935395.590740:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987456:0@lo:503: 00000100:00100000:1.0:1784935395.590774:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.590787:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549464000 going to sleep for 11 seconds 00000100:00100000:1.0:1784935395.590799:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291987456 00000100:00100000:1.0:1784935395.590802:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291987456 00000100:00100000:1.0:1784935395.590819:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784935395.590825:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:8430:x1871640291987456:12345-0@lo:503: 00000100:00100000:1.0:1784935395.590894:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:8430:x1871640291987456:12345-0@lo:503: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.590901:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784935395.590957:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987456:0@lo:503: 00000040:00080000:1.0:1784935395.591130:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784935395.591173:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987584:0@lo:502: 00000100:00100000:1.0:1784935395.591205:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.591219:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549464000 going to sleep for 11 seconds 00000100:00100000:1.0:1784935395.591234:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291987584 00000100:00100000:1.0:1784935395.591238:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291987584 00000100:00100000:1.0:1784935395.591255:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784935395.591261:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:8430:x1871640291987584:12345-0@lo:502: 00000100:00100000:1.0:1784935395.591327:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:8430:x1871640291987584:12345-0@lo:502: Request processed in 65us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.591339:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784935395.592957:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987584:0@lo:502: 00000040:00080000:0.0:1784935395.593205:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784935395.593237:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784935395.593252:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784935395.593267:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784935395.593280:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784935395.593293:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784935395.593310:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784935395.593323:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784935395.593334:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784935395.593482:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784935395.593499:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784935395.593513:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784935395.593527:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784935395.593538:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784935395.593564:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784935395.593578:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784935395.593589:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1784935395.593602:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1784935395.593614:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1784935395.593627:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1784935395.593759:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1784935395.593775:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1784935395.593788:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1784935395.593801:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1784935395.593815:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1784935395.593828:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1784935395.593841:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1784935395.593854:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1784935395.593866:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1784935395.593878:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1784935395.593890:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1784935395.593902:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1784935395.593915:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1784935395.593993:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1784935395.594012:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1784935395.594026:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1784935395.594054:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1784935395.594094:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987712:0@lo:502: 00000100:00100000:0.0:1784935395.594159:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935395.594241:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935395.597905:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291987712 00000100:00100000:1.0:1784935395.597915:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291987712 00000100:00100000:1.0:1784935395.599355:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784935395.599370:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:8430:x1871640291987712:12345-0@lo:502: 00000100:00100000:1.0:1784935395.599568:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:8430:x1871640291987712:12345-0@lo:502: Request processed in 202us (5408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.599576:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784935395.600717:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291987712:0@lo:502: 00000040:00080000:3.0:1784935395.600805:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1784935395.600819:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1784935395.602605:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784935395.602636:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d444209b380) 00000020:00000080:1.0:1784935395.602660:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1784935395.602863:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457b962000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784935395.602868:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d457b962000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784935395.602870:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457b962000 3 00010000:00080000:1.0:1784935395.602900:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d457d24c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.128@tcp at head 00010000:00010000:1.0:1784935395.604672:0:8460:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1784935395.604769:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1784935395.604808:0:8460:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784935395.604820:0:8460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x857e02f4e0b16316 00000100:00080000:1.0:1784935395.604829:0:8460:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784935395.604835:0:8460:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d457d24c800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935395.604868:0:8460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4566f37b80 x1871640291987840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784935395.604961:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1871640291987840:0@lo:38: 00000100:00100000:3.0:1784935395.605027:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.608409:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291987840 00000100:00100000:1.0:1784935395.608421:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291987840 00000100:00100000:1.0:1784935395.608461:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784935395.608469:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1871640291987840:12345-0@lo:38: 00010000:00080000:1.0:1784935395.608504:0:6525:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1784935395.608546:0:6525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x857e02f4e0b1631d 00000004:00100000:1.0:1784935395.608561:0:6525:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784935395.608601:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8d44421b6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935395.610785:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871640291987840:12345-0@lo:38: Request processed in 2309us (5750us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.610797:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1784935395.610829:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784935395.611106:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640291987968:0@lo:400: 00000100:00100000:2.0:1784935395.611161:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.611258:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291987968 00000100:00100000:1.0:1784935395.611265:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291987968 00000100:00100000:1.0:1784935395.611298:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784935395.611306:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640291987968:12345-0@lo:400: 00010000:00080000:3.0:1784935395.611443:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4566f37b80 x1871640291987840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935395.611453:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784935395.611462:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1784935395.611468:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784935395.611473:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784935395.611483:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d457d24c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784935395.611491:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1871640291987840:0@lo:38: 00000100:00100000:0.0:1784935395.611738:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640291988352:0@lo:400: 00000100:00100000:0.0:1784935395.611768:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935395.611790:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935395.611796:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640291988224:0@lo:400: 00000100:00100000:0.0:1784935395.611816:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935395.611988:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640291988096:0@lo:400: 00000100:00100000:3.0:1784935395.612126:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935395.612197:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291988352 00000100:00100000:0.0:1784935395.612203:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291988352 00000100:00100000:0.0:1784935395.612228:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291988096 00000100:00100000:0.0:1784935395.612231:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291988096 00000100:00100000:0.0:1784935395.612243:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784935395.612250:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640291988352:12345-0@lo:400: 00000100:00100000:0.0:1784935395.612302:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640291988352:12345-0@lo:400: Request processed in 52us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.612308:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784935395.612324:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935395.612330:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640291988096:12345-0@lo:400: 00000100:00100000:0.0:1784935395.612374:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640291988096:12345-0@lo:400: Request processed in 44us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935395.612380:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935395.612408:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640291988096:0@lo:400: 00000100:00100000:3.0:1784935395.612465:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640291988352:0@lo:400: 00010000:00080000:2.0:1784935395.612702:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4566eb6300 x1871640291987968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935395.612712:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640291987968:0@lo:400: 00000100:00100000:1.0:1784935395.612764:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640291987968:12345-0@lo:400: Request processed in 1457us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.612772:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784935395.612787:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291988224 00000100:00100000:1.0:1784935395.612791:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291988224 00000100:00100000:1.0:1784935395.612851:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784935395.612858:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640291988224:12345-0@lo:400: 00000100:00100000:1.0:1784935395.612902:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640291988224:12345-0@lo:400: Request processed in 44us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.612908:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:01000004:1.0:1784935395.613241:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784935395.613256:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d4442098000) 00000020:00000080:1.0:1784935395.613276:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1784935395.615625:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457b962000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784935395.615636:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d457b962000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784935395.615645:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457b962000 3 00010000:00080000:1.0:1784935395.615679:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d44421b0000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.128@tcp at head 00010000:00080000:3.0:1784935395.616667:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4566eb5c00 x1871640291988224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935395.616683:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640291988224:0@lo:400: 00010000:00010000:1.0:1784935395.617808:0:8460:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1784935395.617913:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1784935395.618117:0:8460:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784935395.618129:0:8460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x857e02f4e0b1632b 00000100:00080000:1.0:1784935395.618139:0:8460:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784935395.618145:0:8460:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d44421b0000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935395.618177:0:8460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4566f37100 x1871640291988480/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784935395.618230:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1871640291988480:0@lo:38: 00000100:00100000:3.0:1784935395.618297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784935395.618367:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1784935395.618539:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291988480 00000100:00100000:2.0:1784935395.618546:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291988480 00000100:00100000:2.0:1784935395.618586:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784935395.618592:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1871640291988480:12345-0@lo:38: 00010000:00080000:2.0:1784935395.618615:0:6527:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:2.0:1784935395.618650:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x857e02f4e0b16332 00000004:00100000:2.0:1784935395.618664:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784935395.618694:0:6527:0:(import.c:65:import_set_state_nolock()) ffff8d44419c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784935395.618813:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871640291988480:12345-0@lo:38: Request processed in 219us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.618820:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1784935395.618984:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1784935395.619040:0:8430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1784935395.619070:0:8430:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784935395.619085:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935395.619096:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784935395.619135:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784935395.619137:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784935395.619138:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935395.619139:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935395.619141:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935395.619142:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935395.619144:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784935395.619145:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784935395.619146:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784935395.619148:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935395.619149:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784935395.619153:0:8430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1784935395.619158:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784935395.619160:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784935395.619161:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935395.619162:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935395.619163:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935395.619164:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935395.619165:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784935395.619166:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784935395.619167:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784935395.619167:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935395.619168:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784935395.619181:0:8430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784935395.619191:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291988608:0@lo:253: 00000100:00100000:1.0:1784935395.619225:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935395.619242:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454356be40 going to sleep for 11 seconds 00000100:00100000:1.0:1784935395.619264:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291988608 00000100:00100000:1.0:1784935395.619267:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291988608 00000100:00100000:1.0:1784935395.619295:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784935395.619301:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:8430:x1871640291988608:12345-0@lo:253: 20000000:01000000:1.0:1784935395.619321:0:6520:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784935395.619334:0:6520:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1784935395.619619:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4566f37100 x1871640291988480/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935395.619629:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784935395.619637:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1784935395.619644:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784935395.619648:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784935395.619650:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44421b0000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784935395.619656:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1871640291988480:0@lo:38: 20000000:01000000:1.0:1784935395.624602:0:6520:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784935395.624621:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784935395.624882:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:8430:x1871640291988608:12345-0@lo:253: Request processed in 5576us (5651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935395.624893:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784935395.625013:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8430:1871640291988608:0@lo:253: 10000000:01000000:1.0:1784935395.625026:0:8430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784935395.625029:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784935395.625031:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784935395.625032:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935395.625034:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935395.625035:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935395.625048:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935395.625050:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784935395.625052:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784935395.625053:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784935395.625054:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935395.625056:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784935395.625069:0:8430:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1784935395.628666:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784935395.628676:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784935395.628698:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.628715:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1622f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16228 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.628741:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d454166ac00/0x857e02f4e0b1624b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16244 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.628748:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.628786:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d454166ac00/0x857e02f4e0b1624b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16244 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.628801:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d454166ac00/0x857e02f4e0b1624b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16244 expref: 15 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.628817:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640291988736:0@lo:104: 00000100:00100000:3.0:1784935395.628874:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784935395.628957:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1622f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16228 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935395.628966:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1622f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16228 expref: 15 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935395.628975:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640291988864:0@lo:104: 00000100:00100000:3.0:1784935395.628998:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4566fc60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935395.629213:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784935395.629231:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.629259:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291988736 00000100:00100000:2.0:1784935395.629265:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291988736 00000100:00100000:2.0:1784935395.629301:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291988864 00000100:00100000:2.0:1784935395.629304:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291988864 00000100:00100000:2.0:1784935395.629334:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784935395.629351:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d061050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6541:x1871640291988736:12345-0@lo:104: 00010000:00010000:2.0:1784935395.629363:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b16244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629411:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784935395.629417:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d061050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6541:x1871640291988736:12345-0@lo:104: Request processed in 76us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.629423:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784935395.629461:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784935395.629467:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6541:x1871640291988864:12345-0@lo:104: 00010000:00010000:2.0:1784935395.629475:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629507:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784935395.629513:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6541:x1871640291988864:12345-0@lo:104: Request processed in 46us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.629525:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1784935395.629545:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784935395.629551:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b16244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629558:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166b400 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935395.629563:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b16244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629571:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b16244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935395.629578:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b16244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935395.629584:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935395.629617:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b16244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629623:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935395.629642:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b16244 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629649:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b16244 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1624b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629662:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935395.629664:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629681:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540031800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935395.629685:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629691:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935395.629697:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935395.629702:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935395.629715:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629721:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935395.629727:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16228 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629732:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1622f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629744:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935395.629746:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935395.629748:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935395.629754:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935395.629764:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291988992:0@lo:103: 00000100:00100000:2.0:1784935395.629792:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.629812:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784935395.629818:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291989120:0@lo:103: 00000100:00100000:2.0:1784935395.629847:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935395.629878:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291988992 00000100:00100000:2.0:1784935395.629881:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291988992 00010000:00010000:2.0:1784935395.629899:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d454166ac00/0x857e02f4e0b1624b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16244 expref: 16 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.629919:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291989120 00000100:00100000:2.0:1784935395.629922:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291989120 00010000:00010000:2.0:1784935395.629955:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1622f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16228 expref: 17 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.629968:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784935395.629973:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570540000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:3651:x1871640291988992:12345-0@lo:103: 00010000:00010000:2.0:1784935395.629982:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935395.629987:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d454166ac00/0x857e02f4e0b1624b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16244 expref: 17 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.629996:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d454166ac00/0x857e02f4e0b1624b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16244 expref: 17 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630011:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935395.630038:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570540000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:3651:x1871640291988992:12345-0@lo:103: Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.630043:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784935395.630056:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784935395.630061:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570542300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3651:x1871640291989120:12345-0@lo:103: 00010000:00010000:2.0:1784935395.630069:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935395.630073:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1622f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16228 expref: 16 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630092:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1622f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16228 expref: 16 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630104:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630112:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784935395.630125:0:6512:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004182949s 00010000:00010000:2.0:1784935395.630130:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630137:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630143:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630150:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630156:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021800 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935395.630159:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630166:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630173:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630193:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935395.630218:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570542300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3651:x1871640291989120:12345-0@lo:103: Request processed in 156us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935395.630224:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784935395.630261:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291989120:0@lo:103: 00000100:00100000:2.0:1784935395.630269:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291988992:0@lo:103: 00010000:00010000:2.0:1784935395.630297:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166ac00/0x857e02f4e0b1624b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16244 expref: 15 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.630307:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640291988736:0@lo:104: 00010000:00010000:2.0:1784935395.630316:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1622f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16228 expref: 14 pid: 6520 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935395.630324:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640291988864:0@lo:104: 00010000:00010000:2.0:1784935395.630359:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630369:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630374:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935395.630380:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554021800/0x857e02f4e0b16339 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1784935395.634822:0:8430:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1784935395.635592:0:8430:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1784935395.636101:0:8430:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1784935395.636295:0:8430:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1784935395.636574:0:8430:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1784935395.636842:0:8430:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1784935395.640758:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1784935395.650997:0:8430:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1784935395.651006:0:8430:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1784935395.651061:0:8430:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784935395.651097:0:8430:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.128@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784935395.651116:0:8430:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1784935395.651139:0:8430:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1784935395.654547:0:8430:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784935395.654729:0:8430:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1784935396.269529:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640291989248:0@lo:41: 00000100:00100000:1.0:1784935396.269597:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935396.269666:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291989248 00000100:00100000:1.0:1784935396.269674:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291989248 00000100:00100000:1.0:1784935396.269718:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784935396.269725:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640291989248:12345-0@lo:41: 00000004:00000024:1.0:1784935396.269756:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1784935396.269802:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640291989248:12345-0@lo:41: Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935396.269808:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784935396.269850:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640291989248:0@lo:41: 00010000:00010000:0.0:1784935396.463545:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784935396.596787:0:8516:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784935396.597214:0:8516:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784935397.489015:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935398.510463:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935398.829536:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784935398.830272:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291989376:0@lo:41: 00000100:00100000:0.0:1784935398.830480:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935398.831183:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291989376 00000100:00100000:1.0:1784935398.831192:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291989376 00000100:00100000:1.0:1784935398.831278:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784935398.831287:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640291989376:12345-0@lo:41: 00000004:00000024:1.0:1784935398.831329:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1784935398.831402:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640291989376:12345-0@lo:41: Request processed in 115us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935398.831409:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784935398.831487:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291989376:0@lo:41: 00010000:00010000:0.0:1784935399.533602:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935400.559305:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935400.877623:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640291989632:0@lo:400: 00000100:00100000:1.0:1784935400.877686:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935400.877732:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640291990144:0@lo:400: 00000100:00100000:1.0:1784935400.877755:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935400.877779:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784935400.877784:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640291989504:0@lo:400: 00000100:00100000:1.0:1784935400.877806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935400.877823:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640291990016:0@lo:400: 00000100:00100000:1.0:1784935400.877842:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935400.877863:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640291989888:0@lo:400: 00000100:00100000:1.0:1784935400.877900:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935400.877916:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784935400.877920:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640291989760:0@lo:400: 00000100:00100000:1.0:1784935400.877957:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935400.877972:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640291990272:0@lo:400: 00000100:00100000:1.0:1784935400.878007:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935400.878035:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291989504 00000100:00100000:1.0:1784935400.878042:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291989504 00000100:00100000:1.0:1784935400.878097:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784935400.878106:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:3652:x1871640291989504:12345-0@lo:400: 00000100:00100000:1.0:1784935400.878152:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:3652:x1871640291989504:12345-0@lo:400: Request processed in 47us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935400.878159:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784935400.878190:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291990016 00000100:00100000:1.0:1784935400.878194:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291990016 00000100:00100000:1.0:1784935400.878209:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291989760 00000100:00100000:1.0:1784935400.878212:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291989760 00000100:00100000:1.0:1784935400.878223:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784935400.878228:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640291990016:12345-0@lo:400: 00000100:00100000:1.0:1784935400.878263:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640291990016:12345-0@lo:400: Request processed in 33us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935400.878269:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784935400.878282:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784935400.878288:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640291989760:12345-0@lo:400: 00000100:00100000:1.0:1784935400.878328:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640291989760:12345-0@lo:400: Request processed in 40us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935400.878334:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784935400.878351:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291989632 00000100:00100000:1.0:1784935400.878355:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291989632 00000100:00100000:1.0:1784935400.878384:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291990144 00000100:00100000:1.0:1784935400.878387:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291990144 00000100:00100000:1.0:1784935400.878409:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291989888 00000100:00100000:1.0:1784935400.878412:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291989888 00000100:00100000:1.0:1784935400.878433:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291990272 00000100:00100000:1.0:1784935400.878436:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291990272 00000100:00100000:1.0:1784935400.878450:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784935400.878456:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640291989632:12345-0@lo:400: 00000100:00100000:1.0:1784935400.878489:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640291989632:12345-0@lo:400: Request processed in 32us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935400.878494:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784935400.878506:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784935400.878512:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640291990144:12345-0@lo:400: 00000100:00100000:1.0:1784935400.878535:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640291990144:12345-0@lo:400: Request processed in 24us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935400.878541:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784935400.878550:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784935400.878556:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640291989888:12345-0@lo:400: 00000100:00100000:1.0:1784935400.878580:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640291989888:12345-0@lo:400: Request processed in 24us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935400.878585:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784935400.878594:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784935400.878599:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640291990272:12345-0@lo:400: 00000100:00100000:1.0:1784935400.878621:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640291990272:12345-0@lo:400: Request processed in 22us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935400.878625:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1784935400.878651:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784935400.878654:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935400.878678:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640291989760:0@lo:400: 00010000:00080000:1.0:1784935400.878691:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4566f36680 x1871640291990272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935400.878715:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640291990272:0@lo:400: 00010000:00080000:1.0:1784935400.878727:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4566f35880 x1871640291989888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935400.878735:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640291989888:0@lo:400: 00000100:00100000:1.0:1784935400.878764:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640291989504:0@lo:400: 00000100:00100000:1.0:1784935400.878772:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640291990016:0@lo:400: 00010000:00080000:1.0:1784935400.878780:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4566f34e00 x1871640291989632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935400.878787:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640291989632:0@lo:400: 00010000:00080000:1.0:1784935400.878796:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4566f37480 x1871640291990144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935400.878803:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640291990144:0@lo:400: 00000100:00100000:1.0:1784935401.389182:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935401.389207:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640291990400:0@lo:41: 00000100:00100000:1.0:1784935401.389268:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935401.389339:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291990400 00000100:00100000:2.0:1784935401.389346:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291990400 00000100:00100000:2.0:1784935401.389393:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784935401.389401:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640291990400:12345-0@lo:41: 00000004:00000024:2.0:1784935401.389431:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1784935401.389490:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640291990400:12345-0@lo:41: Request processed in 89us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935401.389497:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784935401.389537:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640291990400:0@lo:41: 00010000:00010000:0.0:1784935401.581187:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784935401.905217:0:8806:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784935402.605343:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784935402.721614:0:8858:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784935402.721852:0:8858:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784935403.630593:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935403.949292:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935403.949335:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640291990528:0@lo:41: 00000100:00100000:1.0:1784935403.949450:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935403.949619:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291990528 00000100:00100000:2.0:1784935403.949632:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291990528 00000100:00100000:2.0:1784935403.949697:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784935403.949708:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640291990528:12345-0@lo:41: 00000004:00000024:2.0:1784935403.949757:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1784935403.949812:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640291990528:12345-0@lo:41: Request processed in 105us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935403.949819:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784935403.950129:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640291990528:0@lo:41: 00010000:00010000:2.0:1784935404.656397:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784935405.243546:0:8959:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784935405.243743:0:8959:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1784935405.489310:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784935405.489318:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4570c47800 from 30 10000000:01000000:1.0:1784935405.489334:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784935405.489374:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935405.489384:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935405.489396:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935405.489419:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291990656:0@lo:101: 00000100:00100000:1.0:1784935405.489482:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.489537:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454356bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935405.490090:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291990656 00000100:00100000:3.0:1784935405.490098:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291990656 00000100:00100000:3.0:1784935405.490157:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784935405.490168:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:6523:x1871640291990656:12345-0@lo:101: 00010000:00010000:3.0:1784935405.490181:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935405.490197:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554021200/0x857e02f4e0b16347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16340 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935405.490229:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554021200/0x857e02f4e0b16347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16340 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935405.490240:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554021200/0x857e02f4e0b16347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16340 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935405.490249:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021200, rc 0) 00000100:00100000:3.0:1784935405.490313:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291990656:12345-0@lo:101: Request processed in 147us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935405.490321:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784935405.490356:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291990656:0@lo:101: 00010000:00010000:2.0:1784935405.490376:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.490387:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935405.490470:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570540e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291990784:0@lo:501: 00000100:00100000:2.0:1784935405.490501:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.490531:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45433abcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935405.492701:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291990784 00000100:00100000:1.0:1784935405.492713:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291990784 00000100:00100000:1.0:1784935405.492772:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784935405.492782:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291990784:12345-0@lo:501: 00000100:00100000:1.0:1784935405.492964:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291990784:12345-0@lo:501: Request processed in 183us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935405.492972:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784935405.492998:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570540e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291990784:0@lo:501: 00000100:00100000:2.0:1784935405.493053:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570540e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291990912:0@lo:503: 00000100:00100000:2.0:1784935405.493100:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.493132:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45433abcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935405.493258:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291990912 00000100:00100000:3.0:1784935405.493263:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291990912 00000100:00100000:3.0:1784935405.493303:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784935405.493309:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291990912:12345-0@lo:503: 00000100:00100000:3.0:1784935405.493407:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291990912:12345-0@lo:503: Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935405.493413:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784935405.493549:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570540e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291990912:0@lo:503: 00000100:00100000:2.0:1784935405.500015:0:8975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570543b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8975:1871640291991040:0@lo:502: 00000100:00100000:2.0:1784935405.500093:0:8975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.500133:0:8975:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45433aba80 going to sleep for 11 seconds 00000100:00100000:3.0:1784935405.500339:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291991040 00000100:00100000:3.0:1784935405.500346:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291991040 00000100:00100000:3.0:1784935405.500396:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784935405.500414:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8975:x1871640291991040:12345-0@lo:502: 00000100:00100000:3.0:1784935405.500538:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8975:x1871640291991040:12345-0@lo:502: Request processed in 133us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935405.500545:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784935405.500890:0:8975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570543b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8975:1871640291991040:0@lo:502: 00000100:00100000:0.0:1784935405.501069:0:8975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8975:1871640291991168:0@lo:502: 00000100:00100000:1.0:1784935405.501429:0:8975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.501491:0:8975:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455199fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.504472:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291991168 00000100:00100000:2.0:1784935405.504487:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291991168 00000100:00100000:3.0:1784935405.504681:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784935405.504693:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8975:x1871640291991168:12345-0@lo:502: 00000100:00100000:3.0:1784935405.505483:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:8975:x1871640291991168:12345-0@lo:502: Request processed in 788us (4050us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935405.505570:0:8975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8975:1871640291991168:0@lo:502: 00000040:00080000:0.0:1784935405.505605:0:8975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784935405.505752:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784935405.505772:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784935405.505781:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935405.505791:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935405.505799:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784935405.505801:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4570c47800 from 5 10000000:01000000:0.0:1784935405.505804:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784935405.505833:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935405.505841:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935405.505851:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935405.505869:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291991296:0@lo:101: 00000100:00100000:0.0:1784935405.505905:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935405.505955:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45506f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935405.507349:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784935405.507363:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291991296 00000100:00100000:2.0:1784935405.507371:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291991296 00000100:00100000:2.0:1784935405.507407:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784935405.507414:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640291991296:12345-0@lo:101: 00010000:00010000:2.0:1784935405.507428:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935405.507445:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1634e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.507467:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1634e expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.507476:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1634e expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.507503:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541528600, rc 0) 00000100:00100000:2.0:1784935405.507565:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640291991296:12345-0@lo:101: Request processed in 151us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935405.507615:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291991296:0@lo:101: 00010000:00010000:0.0:1784935405.507630:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935405.507647:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935405.507696:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291991424:0@lo:256: 00000100:00100000:0.0:1784935405.507730:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935405.507763:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45506f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935405.507878:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291991424 00000100:00100000:3.0:1784935405.507881:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291991424 00000100:00100000:3.0:1784935405.507901:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784935405.507908:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291991424:12345-0@lo:256: 20000000:01000000:3.0:1784935405.508360:0:6518:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784935405.508655:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784935405.508660:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1784935405.508758:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291991424:12345-0@lo:256: Request processed in 848us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935405.508767:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784935405.508846:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291991424:0@lo:256: 10000000:01000000:1.0:1784935405.508894:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784935405.508902:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935405.508958:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935405.508968:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784935405.509445:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1784935405.509448:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784935405.509475:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935405.509484:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935405.509493:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935405.509511:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291991552:0@lo:101: 00000100:00100000:1.0:1784935405.509543:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.509559:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1efa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.509605:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784935405.509632:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291991552 00000100:00100000:2.0:1784935405.509637:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291991552 00000100:00100000:2.0:1784935405.509737:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784935405.509745:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640291991552:12345-0@lo:101: 00010000:00010000:2.0:1784935405.509755:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935405.509767:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541529800/0x857e02f4e0b16363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1635c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.509787:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541529800/0x857e02f4e0b16363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1635c expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.509796:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541529800/0x857e02f4e0b16363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1635c expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.509805:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529800, rc 0) 00000100:00100000:2.0:1784935405.509846:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291991552:12345-0@lo:101: Request processed in 103us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935405.509852:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784935405.510974:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291991552:0@lo:101: 00010000:00010000:1.0:1784935405.510994:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935405.511005:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935405.511079:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291991680:0@lo:501: 00000100:00100000:1.0:1784935405.511122:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935405.517319:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291991680 00000100:00100000:0.0:1784935405.517334:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291991680 00000100:00100000:3.0:1784935405.517407:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784935405.517421:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291991680:12345-0@lo:501: 00000100:00100000:3.0:1784935405.517605:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291991680:12345-0@lo:501: Request processed in 186us (6480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935405.517623:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784935405.517682:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1efa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784935405.517707:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291991680:0@lo:501: 00000100:00100000:1.0:1784935405.517754:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291991808:0@lo:503: 00000100:00100000:1.0:1784935405.517883:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.517909:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1efa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.518036:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291991808 00000100:00100000:2.0:1784935405.518040:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291991808 00000100:00100000:2.0:1784935405.518071:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784935405.518078:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291991808:12345-0@lo:503: 00000100:00100000:2.0:1784935405.519081:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291991808:12345-0@lo:503: Request processed in 998us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935405.519518:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291991808:0@lo:503: 00000100:00100000:1.0:1784935405.519701:0:8978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8978:1871640291991936:0@lo:502: 00000100:00100000:1.0:1784935405.519745:0:8978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.519776:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291991936 00000100:00100000:1.0:1784935405.519782:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291991936 00000100:00100000:2.0:1784935405.519881:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784935405.519987:0:8978:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e3a46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935405.521210:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784935405.521225:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:8978:x1871640291991936:12345-0@lo:502: 00000100:00100000:2.0:1784935405.522030:0:8978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8978:1871640291991936:0@lo:502: 00000020:01000000:2.0:1784935405.522066:0:8978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784935405.522074:0:8978:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1784935405.522081:0:8978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935405.522083:0:8978:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784935405.522262:0:8978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784935405.522267:0:8978:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:01000000:2.0:1784935405.522300:0:8978:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1784935405.522304:0:8978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784935405.522319:0:8978:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d4581c94d40) 00000020:00000080:2.0:1784935405.522342:0:8978:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1784935405.522348:0:8978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1784935405.522473:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:8978:x1871640291991936:12345-0@lo:502: Request processed in 1251us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935405.522481:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000004:00080000:2.0:1784935405.522722:0:8978:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1784935405.522729:0:8978:0:(osd_handler.c:8933:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784935405.522736:0:8978:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b16371 00010000:00080000:2.0:1784935405.522765:0:8978:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d44419c3000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.128@tcp at head 00010000:00010000:2.0:1784935405.523718:0:8978:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1784935405.551008:0:8978:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1784935405.551035:0:8978:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1784935405.551240:0:8978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935405.551473:0:8978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935405.552040:0:8978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1784935405.552155:0:8978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1784935405.555505:0:8980:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784935405.555515:0:8980:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784935405.558243:0:8978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784935405.558257:0:8978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784935405.558312:0:8978:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784935405.558334:0:8978:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b16378 00000100:00080000:1.0:1784935405.558345:0:8978:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784935405.558351:0:8978:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d44419c3000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935405.558386:0:8978:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d44410faa00 x1871640291992064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784935405.558420:0:8978:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1784935405.558458:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640291992064:0@lo:8: 00000020:01000000:1.0:1784935405.558484:0:8978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935405.558489:0:8978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935405.558492:0:8978:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784935405.558495:0:8978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935405.558500:0:8978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935405.558502:0:8978:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784935405.558506:0:8978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784935405.558508:0:8978:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784935405.558537:0:8978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8978:1871640291992192:0@lo:502: 00000100:00100000:2.0:1784935405.558546:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.558599:0:8978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.558626:0:8978:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45729f0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784935405.559356:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291992448:0@lo:400: 00000100:00100000:3.0:1784935405.559390:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.564177:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291992192 00000100:00100000:2.0:1784935405.564192:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291992192 00000100:00100000:2.0:1784935405.564783:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784935405.564793:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:8978:x1871640291992192:12345-0@lo:502: 00000100:00100000:1.0:1784935405.564972:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640291992320:0@lo:400: 00000100:00100000:1.0:1784935405.565040:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.565101:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291992320 00000100:00100000:1.0:1784935405.565107:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291992320 00000100:00100000:1.0:1784935405.565137:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784935405.565144:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640291992320:12345-0@lo:400: 00000100:00100000:1.0:1784935405.565185:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640291992320:12345-0@lo:400: Request processed in 41us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935405.565192:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1784935405.565232:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4566eb5c00 x1871640291992320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935405.565246:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640291992320:0@lo:400: 00000100:00100000:2.0:1784935405.565333:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:8978:x1871640291992192:12345-0@lo:502: Request processed in 540us (6734us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935405.565350:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784935405.565477:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640291992576:0@lo:400: 00000100:00100000:2.0:1784935405.565508:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935405.565522:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291992064 00000100:00100000:0.0:1784935405.565528:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291992064 00000100:00100000:2.0:1784935405.565536:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935405.565543:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640291992960:0@lo:400: 00000100:00100000:0.0:1784935405.565552:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784935405.565559:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1871640291992064:12345-0@lo:8: 00000100:00100000:2.0:1784935405.565579:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784935405.565584:0:8439:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1784935405.565610:0:8439:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b1637f 00002000:00100000:0.0:1784935405.565646:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d45757df000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1784935405.565650:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1784935405.565654:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784935405.565709:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1784935405.565879:0:8978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8978:1871640291992192:0@lo:502: 00000020:01000000:1.0:1784935405.565908:0:8978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935405.565919:0:8978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935405.565922:0:8978:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784935405.565946:0:8978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1784935405.566286:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1784935405.566311:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00002000:00080000:0.0:1784935405.566317:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00010000:00010000:2.0:1784935405.566321:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.566332:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784935405.566340:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8d45757d8000 : changing import state from RECOVER to FULL 10000000:01000000:2.0:1784935405.566342:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784935405.566347:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4570329000 from 30 10000000:01000000:2.0:1784935405.566350:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:0.0:1784935405.566441:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1871640291992064:12345-0@lo:8: Request processed in 882us (7897us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935405.566449:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784935405.566478:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640291992704:0@lo:400: 00000100:00100000:0.0:1784935405.566508:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640291992832:0@lo:400: 00000100:00100000:0.0:1784935405.566542:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935405.566575:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291992576 00000100:00100000:0.0:1784935405.566579:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291992576 00000100:00100000:0.0:1784935405.566599:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291992960 00000100:00100000:0.0:1784935405.566601:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291992960 00000100:00100000:0.0:1784935405.566616:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291992832 00000100:00100000:0.0:1784935405.566618:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291992832 00000100:00100000:0.0:1784935405.566630:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784935405.566635:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640291992576:12345-0@lo:400: 00000100:00100000:0.0:1784935405.566670:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640291992576:12345-0@lo:400: Request processed in 36us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935405.566676:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784935405.566686:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784935405.566691:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640291992960:12345-0@lo:400: 00000100:00100000:0.0:1784935405.566713:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640291992960:12345-0@lo:400: Request processed in 23us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935405.566732:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784935405.566807:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784935405.566814:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640291992832:12345-0@lo:400: 00000100:00100000:0.0:1784935405.566844:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640291992832:12345-0@lo:400: Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935405.566850:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1784935405.566901:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4566eb5500 x1871640291992832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935405.566913:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640291992832:0@lo:400: 00010000:00080000:0.0:1784935405.567100:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574337800 x1871640291992960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935405.567120:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640291992960:0@lo:400: 00010000:00080000:0.0:1784935405.567133:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4566eb7100 x1871640291992576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935405.567141:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640291992576:0@lo:400: 00000100:00100000:0.0:1784935405.567299:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935405.567370:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291992448 00000100:00100000:3.0:1784935405.567376:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291992448 00000100:00100000:3.0:1784935405.567402:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291992704 00000100:00100000:3.0:1784935405.567405:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291992704 00000100:00100000:3.0:1784935405.567417:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1784935405.567428:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935405.567433:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640291992448:12345-0@lo:400: 00010000:00010000:2.0:1784935405.567444:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.567455:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935405.567473:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291993088:0@lo:101: 00000100:00100000:3.0:1784935405.567495:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640291992448:12345-0@lo:400: Request processed in 64us (8102us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935405.567503:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784935405.567514:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935405.567521:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784935405.567531:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640291992704:12345-0@lo:400: 00000100:00100000:2.0:1784935405.567559:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45433ab240 going to sleep for 11 seconds 00000100:00100000:3.0:1784935405.567570:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640291992704:12345-0@lo:400: Request processed in 39us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935405.567578:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784935405.567645:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640291992704:0@lo:400: 00000100:00100000:0.0:1784935405.567669:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291992448:0@lo:400: 00010000:00080000:1.0:1784935405.567866:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44410faa00 x1871640291992064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784935415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935405.567876:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784935405.567883:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1784935405.567890:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784935405.567895:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784935405.567898:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44419c3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784935405.567987:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784935405.567993:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640291992064:0@lo:8: 00000100:00080000:1.0:1784935405.568022:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935405.568027:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935405.568037:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291993088 00000100:00100000:1.0:1784935405.568041:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291993088 00000100:00100000:1.0:1784935405.568068:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784935405.568074:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640291993088:12345-0@lo:101: 00010000:00010000:1.0:1784935405.568083:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935405.568096:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d454166b400/0x857e02f4e0b1638d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16386 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935405.568117:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d454166b400/0x857e02f4e0b1638d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16386 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935405.568127:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d454166b400/0x857e02f4e0b1638d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16386 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935405.568135:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d454166b400, rc 0) 00000100:00100000:1.0:1784935405.568177:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291993088:12345-0@lo:101: Request processed in 103us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935405.568183:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784935405.568216:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291993088:0@lo:101: 00010000:00010000:1.0:1784935405.568229:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935405.568237:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935405.568416:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291993216:0@lo:501: 00000100:00100000:1.0:1784935405.568443:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.568465:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45729f0780 going to sleep for 11 seconds 00000100:00100000:1.0:1784935405.568477:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291993216 00000100:00100000:1.0:1784935405.568480:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291993216 00000100:00100000:1.0:1784935405.568511:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784935405.568517:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291993216:12345-0@lo:501: 00000100:00100000:1.0:1784935405.568625:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291993216:12345-0@lo:501: Request processed in 108us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935405.568631:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784935405.568657:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291993216:0@lo:501: 00000100:00100000:1.0:1784935405.568685:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291993344:0@lo:503: 00000004:00080000:2.0:1784935405.568717:0:8980:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784935405.568789:0:8980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 224818861025ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784935405.568796:0:8980:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1784935405.569031:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.569088:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4548362180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935405.569118:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291993344 00000100:00100000:0.0:1784935405.569122:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291993344 00000100:00100000:3.0:1784935405.569224:0:8981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8981:1871640291993472:0@lo:700: 00000100:00100000:3.0:1784935405.569265:0:8981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935405.569296:0:8981:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935405.569349:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784935405.569360:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291993344:12345-0@lo:503: 00000100:00100000:0.0:1784935405.569473:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291993344:12345-0@lo:503: Request processed in 116us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935405.569479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784935405.569548:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291993344:0@lo:503: 00000100:00100000:3.0:1784935405.570128:0:8982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8982:1871640291993600:0@lo:502: 00000100:00100000:3.0:1784935405.570175:0:8982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.570183:0:8447:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291993472 00000100:00100000:2.0:1784935405.570190:0:8447:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291993472 00000100:00080000:1.0:1784935405.570369:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1784935405.572691:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1784935405.573711:0:8982:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1bbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.573721:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784935405.573737:0:8447:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8981:x1871640291993472:12345-0@lo:700: 00000100:00100000:2.0:1784935405.573942:0:8447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d97100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1871640291993728:0@lo:700: 00000100:00100000:0.0:1784935405.573982:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291993600 00000100:00100000:0.0:1784935405.573990:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291993600 00000100:00100000:2.0:1784935405.573997:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.574019:0:8447:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45433ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1784935405.574036:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784935405.574044:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:8982:x1871640291993600:12345-0@lo:502: 00000100:00100000:0.0:1784935405.574173:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:8982:x1871640291993600:12345-0@lo:502: Request processed in 129us (3999us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935405.574181:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784935405.574262:0:8982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8982:1871640291993600:0@lo:502: 00000100:00100000:3.0:1784935405.574310:0:6532:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291993728 00000100:00100000:3.0:1784935405.574315:0:6532:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291993728 00000100:00100000:2.0:1784935405.574326:0:8982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8982:1871640291993856:0@lo:502: 00000100:00100000:3.0:1784935405.574346:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784935405.574414:0:6532:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1871640291993728:12345-0@lo:700: 00000100:00100000:2.0:1784935405.575584:0:8982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.575625:0:8982:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45433ab6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935405.575679:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291993856 00000100:00100000:0.0:1784935405.575687:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291993856 00000100:00100000:0.0:1784935405.575735:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784935405.575751:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:8982:x1871640291993856:12345-0@lo:502: 00000100:00100000:0.0:1784935405.575868:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:8982:x1871640291993856:12345-0@lo:502: Request processed in 126us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935405.575875:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784935405.575987:0:8982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8982:1871640291993856:0@lo:502: 00000040:00080000:2.0:1784935405.576013:0:8982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784935405.577642:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 40000000:02000000:3.0:1784935405.587397:0:6532:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 10000000:01000000:0.0:1784935405.591328:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784935405.591341:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935405.591352:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935405.591362:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784935405.591366:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4570329000 from 5 10000000:01000000:0.0:1784935405.591368:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784935405.591408:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935405.591415:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935405.591425:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935405.591447:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574334e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291993984:0@lo:101: 00000100:00100000:0.0:1784935405.591510:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935405.591565:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45506f6900 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.591651:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291993984 00000100:00100000:2.0:1784935405.591658:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291993984 00000100:00100000:2.0:1784935405.591711:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784935405.591721:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640291993984:12345-0@lo:101: 00010000:00010000:2.0:1784935405.591733:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935405.591746:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b1639b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16394 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.591769:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b1639b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16394 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.591796:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b1639b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16394 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.591805:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541528a00, rc 0) 00000100:00100000:2.0:1784935405.591848:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640291993984:12345-0@lo:101: Request processed in 129us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935405.591855:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784935405.591902:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574334e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291993984:0@lo:101: 00010000:00010000:2.0:1784935405.591915:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.591923:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935405.591988:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291994112:0@lo:256: 00000100:00100000:2.0:1784935405.592017:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.592034:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45433ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.592047:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291994112 00000100:00100000:2.0:1784935405.592050:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291994112 00000100:00100000:2.0:1784935405.592071:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784935405.592077:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640291994112:12345-0@lo:256: 20000000:01000000:2.0:1784935405.592091:0:6518:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784935405.592107:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784935405.592110:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1784935405.592191:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640291994112:12345-0@lo:256: Request processed in 114us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935405.592198:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784935405.592235:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291994112:0@lo:256: 10000000:01000000:2.0:1784935405.592269:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784935405.592287:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.592295:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935405.592301:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784935405.592303:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1784935405.592305:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784935405.592321:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.592328:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.592335:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935405.592346:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291994240:0@lo:101: 00000100:00100000:2.0:1784935405.592369:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.592381:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45433ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.592392:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291994240 00000100:00100000:2.0:1784935405.592395:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291994240 00000100:00100000:2.0:1784935405.592415:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784935405.592421:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640291994240:12345-0@lo:101: 00010000:00010000:2.0:1784935405.592428:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935405.592435:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b163a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b163a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.592465:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b163a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b163a2 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.592473:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b163a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b163a2 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.592479:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529e00, rc 0) 00000100:00100000:2.0:1784935405.592507:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640291994240:12345-0@lo:101: Request processed in 86us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935405.592513:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784935405.592543:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291994240:0@lo:101: 00010000:00010000:2.0:1784935405.592553:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.592560:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935405.592604:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291994368:0@lo:501: 00000100:00100000:2.0:1784935405.592627:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.592638:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542adf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.592647:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291994368 00000100:00100000:2.0:1784935405.592650:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291994368 00000100:00100000:2.0:1784935405.592669:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784935405.592674:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640291994368:12345-0@lo:501: 00000100:00100000:2.0:1784935405.592772:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640291994368:12345-0@lo:501: Request processed in 97us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935405.592778:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784935405.592811:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291994368:0@lo:501: 00000100:00100000:2.0:1784935405.592847:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291994496:0@lo:503: 00000100:00100000:2.0:1784935405.592881:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.592894:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542adf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.592904:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291994496 00000100:00100000:2.0:1784935405.592908:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291994496 00000100:00100000:2.0:1784935405.593688:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784935405.593703:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640291994496:12345-0@lo:503: 00000100:00100000:2.0:1784935405.594025:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640291994496:12345-0@lo:503: Request processed in 326us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935405.594034:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784935405.594099:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291994496:0@lo:503: 00000100:00100000:2.0:1784935405.596822:0:8983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8983:1871640291994624:0@lo:502: 00000100:00100000:2.0:1784935405.596905:0:8983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.597104:0:8983:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542adfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935405.598853:0:6532:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1871640291993728:12345-0@lo:700: Request processed in 24435us (24850us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935405.598866:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784935405.599139:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4581d97100 x1871640291993728/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784935421 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935405.599166:0:8447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d97100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1871640291993728:0@lo:700: 40000000:02000000:1.0:1784935405.599178:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1784935405.606840:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291994624 00000100:00100000:0.0:1784935405.606857:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291994624 00000100:00100000:0.0:1784935405.606916:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784935405.606941:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:8983:x1871640291994624:12345-0@lo:502: 00000100:00100000:0.0:1784935405.607115:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:8983:x1871640291994624:12345-0@lo:502: Request processed in 188us (10209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935405.607123:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784935405.607659:0:8983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8983:1871640291994624:0@lo:502: 00000020:01000000:2.0:1784935405.607700:0:8983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784935405.607707:0:8983:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784935405.607714:0:8983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935405.607717:0:8983:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784935405.607723:0:8983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784935405.607727:0:8983:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:01000000:2.0:1784935405.607749:0:8983:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784935405.607752:0:8983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784935405.607777:0:8983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d457e8899c0) 00000020:00000080:2.0:1784935405.607806:0:8983:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1784935405.607817:0:8983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784935405.607920:0:8983:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784935405.607943:0:8983:0:(osd_handler.c:8933:osd_obd_connect()) connect #6 00000020:00000080:2.0:1784935405.607953:0:8983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b163b7 00010000:00080000:2.0:1784935405.607981:0:8983:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d457e89e000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.128@tcp at head 00010000:00010000:2.0:1784935405.609107:0:8983:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:2.0:1784935405.615828:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1784935405.616006:0:8447:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8981:x1871640291993472:12345-0@lo:700: Request processed in 42270us (46735us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935405.616024:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784935405.616343:0:8981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44419c9180 x1871640291993472/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784935421 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935405.616372:0:8981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8981:1871640291993472:0@lo:700: 00000040:01000000:2.0:1784935405.618144:0:8983:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1784935405.618165:0:8983:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784935405.618356:0:8983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784935405.618535:0:8983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784935405.618619:0:8983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1784935405.618715:0:8983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1784935405.620045:0:8984:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784935405.620052:0:8984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784935405.620958:0:8983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784935405.620969:0:8983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784935405.621004:0:8983:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784935405.621026:0:8983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b163be 00000100:00080000:2.0:1784935405.621036:0:8983:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784935405.621042:0:8983:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d457e89e000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935405.621075:0:8983:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4581d94000 x1871640291994752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935405.621108:0:8983:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1784935405.622239:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640291994752:0@lo:8: 00000100:00100000:1.0:1784935405.622331:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.622404:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291994752 00000100:00100000:1.0:1784935405.622411:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291994752 00000100:00100000:1.0:1784935405.622442:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784935405.622450:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1871640291994752:12345-0@lo:8: 00010000:00080000:1.0:1784935405.622486:0:8441:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1784935405.622520:0:8441:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b163c5 00002000:00100000:1.0:1784935405.622535:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d457d0fd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784935405.622539:0:8441:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784935405.622542:0:8441:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784935405.622624:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784935405.622653:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8d457d0ff800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935405.622711:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1871640291994752:12345-0@lo:8: Request processed in 259us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935405.622718:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784935405.622763:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4581d94000 x1871640291994752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784935415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935405.622773:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784935405.622780:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784935405.622795:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784935405.622799:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784935405.622802:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d457e89e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784935405.622817:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784935405.622821:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640291994752:0@lo:8: 00000004:00080000:2.0:1784935405.626869:0:8984:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784935405.626968:0:8984:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 224877039484ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784935405.626975:0:8984:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:2.0:1784935405.627056:0:8983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935405.627062:0:8983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935405.627064:0:8983:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784935405.627075:0:8983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935405.627078:0:8983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935405.627080:0:8983:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784935405.627083:0:8983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784935405.627085:0:8983:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784935405.627128:0:8983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8983:1871640291994880:0@lo:502: 00000100:00100000:2.0:1784935405.627219:0:8983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.627255:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291994880 00000100:00100000:2.0:1784935405.627261:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291994880 00000100:00100000:2.0:1784935405.627311:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1784935405.627319:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:8983:x1871640291994880:12345-0@lo:502: 00000100:00100000:2.0:1784935405.627421:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:8983:x1871640291994880:12345-0@lo:502: Request processed in 102us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935405.627429:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1784935405.627477:0:8983:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e3a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.627499:0:8983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:8983:1871640291994880:0@lo:502: 00000020:01000000:2.0:1784935405.627524:0:8983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935405.627528:0:8983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935405.627529:0:8983:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784935405.627533:0:8983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1784935405.627588:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1784935405.627610:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784935405.627619:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.627630:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935405.627640:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784935405.627649:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d4572a3b380 from 1 10000000:01000000:2.0:1784935405.627652:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784935405.627676:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.627684:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935405.627693:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935405.627705:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291995008:0@lo:101: 00000100:00100000:2.0:1784935405.627736:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.627751:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935405.627818:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291995008 00000100:00100000:3.0:1784935405.627824:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291995008 00000100:00100000:3.0:1784935405.627858:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784935405.627867:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640291995008:12345-0@lo:101: 00010000:00010000:3.0:1784935405.627877:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935405.627890:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554020200/0x857e02f4e0b163d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b163cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935405.627913:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554020200/0x857e02f4e0b163d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b163cc expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935405.627923:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554020200/0x857e02f4e0b163d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b163cc expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935405.627961:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020200, rc 0) 00000100:00100000:3.0:1784935405.628004:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640291995008:12345-0@lo:101: Request processed in 139us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935405.628010:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784935405.628051:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291995008:0@lo:101: 00010000:00010000:3.0:1784935405.628064:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935405.628073:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935405.628124:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291995136:0@lo:501: 00000100:00100000:3.0:1784935405.628156:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935405.628184:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1bb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.628204:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291995136 00000100:00100000:2.0:1784935405.628209:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291995136 00000100:00100000:2.0:1784935405.628233:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784935405.628240:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640291995136:12345-0@lo:501: 00000100:00100000:2.0:1784935405.628315:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640291995136:12345-0@lo:501: Request processed in 76us (159us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784935405.628322:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784935405.628343:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640291995136:0@lo:501: 10000000:01000000:3.0:1784935405.628369:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784935405.628375:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935405.628382:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784935405.631022:0:8981:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1784935405.631052:0:8981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8981:1871640291995392:0@lo:7: 00000100:00100000:3.0:1784935405.631059:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784935405.631077:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291995264:0@lo:13: 00000100:00100000:1.0:1784935405.631116:0:8981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935405.631120:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.631507:0:8981:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4548362600 going to sleep for 11 seconds 00000100:00100000:1.0:1784935405.631528:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291995392 00000100:00100000:1.0:1784935405.631534:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291995392 00000100:00100000:1.0:1784935405.631583:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784935405.631591:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8981:x1871640291995392:12345-0@lo:7: 00000100:00100000:3.0:1784935405.633070:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291995264 00000100:00100000:3.0:1784935405.633081:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291995264 00000100:00100000:3.0:1784935405.633124:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935405.633133:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1871640291995264:12345-0@lo:13: 00002000:00000024:3.0:1784935405.633160:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923886080 avail 3692363776 00000100:00100000:3.0:1784935405.633247:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1871640291995264:12345-0@lo:13: Request processed in 105us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935405.633256:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784935405.633313:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44410f8a80 x1871640291995264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935405.633335:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291995264:0@lo:13: 00000004:00080000:0.0:1784935405.634657:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1784935405.636094:0:8985:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784935405.636105:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640291995520:0@lo:13: 00000100:00100000:3.0:1784935405.636120:0:8985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8985:1871640291995648:0@lo:7: 00000100:00100000:0.0:1784935405.636176:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935405.636180:0:8985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.636239:0:8440:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1784935405.636257:0:8440:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1784935405.637007:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291995520 00000100:00100000:1.0:1784935405.637016:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291995520 00000100:00100000:1.0:1784935405.637071:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784935405.637080:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1871640291995520:12345-0@lo:13: 00002000:00000024:1.0:1784935405.637101:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923886080 avail 3692363776 00002000:00080000:2.0:1784935405.637179:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1784935405.637184:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1784935405.637860:0:8985:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1bb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935405.638078:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1871640291995520:12345-0@lo:13: Request processed in 996us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935405.638087:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1784935405.638115:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784935405.638179:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44419c8000 x1871640291995520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935405.638198:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640291995520:0@lo:13: 00000100:00100000:2.0:1784935405.638864:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8981:x1871640291995392:12345-0@lo:7: Request processed in 7270us (7744us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935405.638879:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935405.638900:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291995648 00000100:00100000:2.0:1784935405.638905:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291995648 00000100:00100000:2.0:1784935405.638960:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784935405.638968:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8985:x1871640291995648:12345-0@lo:7: 00010000:00080000:1.0:1784935405.639516:0:8981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44410fa680 x1871640291995392/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784935421 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935405.639525:0:8981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8981:1871640291995392:0@lo:7: 00000004:00080000:1.0:1784935405.639538:0:8981:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1784935405.639572:0:8981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8981:1871640291995776:0@lo:5: 00000100:00100000:1.0:1784935405.639602:0:8981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935405.639627:0:8981:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4548362600 going to sleep for 11 seconds 00000100:00100000:0.0:1784935405.639695:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291995776 00000100:00100000:0.0:1784935405.639701:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291995776 00000100:00100000:1.0:1784935405.642369:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784935405.642387:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8981:x1871640291995776:12345-0@lo:5: 00002000:00080000:1.0:1784935405.642418:0:8987:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1784935405.642499:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8981:x1871640291995776:12345-0@lo:5: Request processed in 117us (2894us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935405.642506:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1784935405.642595:0:8981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44410fa680 x1871640291995776/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784935421 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935405.642674:0:8981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8981:1871640291995776:0@lo:5: 00000004:00080000:3.0:1784935405.642687:0:8981:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1784935405.642795:0:8981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8981:1871640291995904:0@lo:5: 00000100:00100000:3.0:1784935405.642830:0:8981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935405.642858:0:8981:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1bb180 going to sleep for 11 seconds 00000100:00100000:1.0:1784935405.642910:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291995904 00000100:00100000:1.0:1784935405.642917:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291995904 00000100:00100000:1.0:1784935405.643013:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784935405.643020:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8981:x1871640291995904:12345-0@lo:5: 00002000:00080000:1.0:1784935405.643042:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1784935405.644536:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8981:x1871640291995904:12345-0@lo:5: Request processed in 1512us (1702us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784935405.644546:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784935405.644640:0:8981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44419cb480 x1871640291995904/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784935421 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935405.644656:0:8981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8981:1871640291995904:0@lo:5: 00000004:00080000:0.0:1784935405.644671:0:8981:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1784935405.644707:0:8981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574335f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8981:1871640291996032:0@lo:900: 00000100:00100000:0.0:1784935405.644742:0:8981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935405.645090:0:8981:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45506f6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784935405.645101:0:6537:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291996032 00000100:00100000:2.0:1784935405.645108:0:6537:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291996032 00000100:00100000:2.0:1784935405.645150:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935405.645158:0:6537:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8981:x1871640291996032:12345-0@lo:900: 00000100:00100000:2.0:1784935405.645206:0:6537:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8981:x1871640291996032:12345-0@lo:900: Request processed in 49us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935405.645211:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784935405.645252:0:8981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574335f80 x1871640291996032/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784935421 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935405.645262:0:8981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574335f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8981:1871640291996032:0@lo:900: 00002000:00080000:2.0:1784935405.645331:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1784935405.645336:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1784935405.645381:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8985:x1871640291995648:12345-0@lo:7: Request processed in 6414us (9203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935405.645389:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784935405.645489:0:8985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44419c8a80 x1871640291995648/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784935421 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935405.645500:0:8985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8985:1871640291995648:0@lo:7: 00000004:00080000:0.0:1784935405.645510:0:8985:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1784935405.645537:0:8985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574336d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8985:1871640291996160:0@lo:5: 00000100:00100000:0.0:1784935405.645564:0:8985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935405.645600:0:8985:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45506f6180 going to sleep for 11 seconds 00000100:00100000:3.0:1784935405.645635:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291996160 00000100:00100000:3.0:1784935405.645641:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291996160 00000100:00100000:3.0:1784935405.645676:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784935405.645682:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8985:x1871640291996160:12345-0@lo:5: 00002000:00080000:3.0:1784935405.645699:0:8441:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784935405.645702:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1784935405.649715:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1784935405.649833:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1784935405.649842:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784935405.650056:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8985:x1871640291996160:12345-0@lo:5: Request processed in 4370us (4487us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784935405.650067:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1784935405.650332:0:8985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574336d80 x1871640291996160/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784935421 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935405.650346:0:8985:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784935405.650353:0:8985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574336d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8985:1871640291996160:0@lo:5: 00000004:00080000:1.0:1784935405.650368:0:8985:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784935405.651018:0:8985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574336a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8985:1871640291996288:0@lo:700: 00000100:00100000:0.0:1784935405.651066:0:8985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935405.651092:0:8985:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45506f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1784935405.651130:0:8448:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291996288 00000100:00100000:1.0:1784935405.651138:0:8448:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291996288 00000100:00100000:1.0:1784935405.651184:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784935405.651200:0:8448:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8985:x1871640291996288:12345-0@lo:700: 00000100:00100000:0.0:1784935405.668525:0:8448:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8985:x1871640291996288:12345-0@lo:700: Request processed in 17316us (17449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935405.668545:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784935405.672205:0:8985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574336a00 x1871640291996288/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784935421 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935405.672226:0:8985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574336a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8985:1871640291996288:0@lo:700: 00000004:02000040:2.0:1784935405.678020:0:8985:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00010000:00010000:0.0:1784935405.680102:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935405.684674:0:8985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d96d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8985:1871640291996416:0@lo:5: 00000100:00100000:2.0:1784935405.684759:0:8985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935405.684816:0:8985:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542adfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784935405.684915:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291996416 00000100:00100000:1.0:1784935405.684922:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291996416 00000100:00100000:1.0:1784935405.684997:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784935405.685005:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8985:x1871640291996416:12345-0@lo:5: 00002000:00080000:1.0:1784935405.691451:0:8987:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1784935405.691469:0:8987:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1784935405.693779:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8985:x1871640291996416:12345-0@lo:5: Request processed in 8769us (9014us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1784935405.693791:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784935405.693859:0:8985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4581d96d80 x1871640291996416/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784935421 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935405.693882:0:8985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d96d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8985:1871640291996416:0@lo:5: 00000004:00080000:2.0:1784935405.693897:0:8985:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:1.0:1784935406.089092:0:9016:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784935406.089103:0:9016:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1784935406.509234:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784935406.509277:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640291996544:0@lo:41: 00000100:00100000:2.0:1784935406.509348:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935406.509631:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291996544 00000100:00100000:3.0:1784935406.509640:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291996544 00000100:00100000:3.0:1784935406.509697:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784935406.509715:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640291996544:12345-0@lo:41: 00000004:00000024:3.0:1784935406.509747:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1784935406.510080:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640291996544:12345-0@lo:41: Request processed in 366us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935406.510088:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784935406.511128:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640291996544:0@lo:41: 00010000:00010000:0.0:1784935406.702648:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935407.728812:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935408.753889:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935409.070064:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935409.070091:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640291996672:0@lo:41: 00000100:00100000:0.0:1784935409.070160:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935409.070267:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291996672 00000100:00100000:1.0:1784935409.070276:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291996672 00000100:00100000:1.0:1784935409.070335:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784935409.070345:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640291996672:12345-0@lo:41: 00000004:00000024:1.0:1784935409.070379:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1784935409.070438:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640291996672:12345-0@lo:41: Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935409.070446:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784935409.070496:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640291996672:0@lo:41: 00010000:00010000:3.0:1784935409.774223:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935410.798526:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935411.119202:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640291996800:0@lo:400: 00000100:00100000:3.0:1784935411.119280:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935411.119402:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640291997312:0@lo:400: 00000100:00100000:3.0:1784935411.119444:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935411.119468:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640291997824:0@lo:400: 00000100:00100000:3.0:1784935411.119493:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935411.119520:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784935411.119526:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640291997184:0@lo:400: 00000100:00100000:3.0:1784935411.119550:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935411.119568:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640291997696:0@lo:400: 00000100:00100000:3.0:1784935411.119586:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935411.119616:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640291996928:0@lo:400: 00000100:00100000:3.0:1784935411.119638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935411.119655:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640291997440:0@lo:400: 00000100:00100000:3.0:1784935411.119674:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935411.119691:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784935411.119697:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640291997056:0@lo:400: 00000100:00100000:3.0:1784935411.119715:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935411.119732:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640291997568:0@lo:400: 00000100:00100000:3.0:1784935411.119750:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935411.119779:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291996800 00000100:00100000:3.0:1784935411.119785:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291996800 00000100:00100000:3.0:1784935411.119824:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784935411.119832:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3650:x1871640291996800:12345-0@lo:400: 00000100:00100000:3.0:1784935411.119889:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3650:x1871640291996800:12345-0@lo:400: Request processed in 57us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935411.119897:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784935411.121101:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291997312 00000100:00100000:3.0:1784935411.121110:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291997312 00000100:00100000:3.0:1784935411.121140:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291997056 00000100:00100000:3.0:1784935411.121143:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291997056 00000100:00100000:3.0:1784935411.121158:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784935411.121165:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640291997312:12345-0@lo:400: 00000100:00100000:3.0:1784935411.121224:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640291997312:12345-0@lo:400: Request processed in 59us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935411.121231:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784935411.121256:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784935411.121263:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640291997056:12345-0@lo:400: 00000100:00100000:3.0:1784935411.121298:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640291997056:12345-0@lo:400: Request processed in 35us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935411.121304:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784935411.122161:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291997824 00000100:00100000:2.0:1784935411.122167:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291997824 00000100:00100000:2.0:1784935411.122202:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291997696 00000100:00100000:2.0:1784935411.122205:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291997696 00000100:00100000:2.0:1784935411.122230:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784935411.122247:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1871640291997824:12345-0@lo:400: 00000100:00100000:2.0:1784935411.122292:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1871640291997824:12345-0@lo:400: Request processed in 56us (2799us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935411.122298:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784935411.122309:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784935411.122407:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291997184 00000100:00100000:3.0:1784935411.122411:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291997184 00000100:00100000:3.0:1784935411.122431:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291996928 00000100:00100000:3.0:1784935411.122433:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291996928 00000100:00100000:3.0:1784935411.122441:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291997440 00000100:00100000:3.0:1784935411.122444:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291997440 00000100:00100000:3.0:1784935411.122454:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291997568 00000100:00100000:3.0:1784935411.122456:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291997568 00000100:00100000:3.0:1784935411.122468:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784935411.122473:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640291997184:12345-0@lo:400: 00000100:00100000:3.0:1784935411.122504:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640291997184:12345-0@lo:400: Request processed in 31us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935411.122517:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784935411.123102:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640291997696:12345-0@lo:400: 00000100:00100000:2.0:1784935411.123143:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640291997696:12345-0@lo:400: Request processed in 828us (3555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935411.123150:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1784935411.123191:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784935411.123195:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784935411.123198:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935411.123212:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640291998080:0@lo:13: 00000100:00100000:2.0:1784935411.123255:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935411.123286:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935411.123292:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640291997952:0@lo:13: 00000100:00100000:3.0:1784935411.123413:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784935411.123421:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640291996928:12345-0@lo:400: 00000100:00100000:3.0:1784935411.123454:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640291996928:12345-0@lo:400: Request processed in 35us (3816us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935411.123459:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784935411.123470:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784935411.123475:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640291997440:12345-0@lo:400: 00000100:00100000:3.0:1784935411.123502:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640291997440:12345-0@lo:400: Request processed in 27us (3827us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935411.123507:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784935411.123518:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784935411.123523:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640291997568:12345-0@lo:400: 00000100:00100000:3.0:1784935411.123548:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640291997568:12345-0@lo:400: Request processed in 25us (3797us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935411.123553:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784935411.123611:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640291997056:0@lo:400: 00010000:00080000:3.0:1784935411.123625:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44419cb800 x1871640291997568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935411.123635:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640291997568:0@lo:400: 00010000:00080000:3.0:1784935411.123646:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44419ca300 x1871640291996928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935411.123654:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640291996928:0@lo:400: 00010000:00080000:3.0:1784935411.123664:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44419c8700 x1871640291997440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935411.123680:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640291997440:0@lo:400: 00010000:00080000:3.0:1784935411.123733:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44419c9500 x1871640291997184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935411.123741:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640291997184:0@lo:400: 00010000:00080000:3.0:1784935411.123750:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44419c8380 x1871640291997696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935411.123757:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784935411.123767:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640291997696:0@lo:400: 00000100:00100000:3.0:1784935411.123778:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640291996800:0@lo:400: 00000100:00100000:3.0:1784935411.123788:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640291997312:0@lo:400: 00010000:00080000:3.0:1784935411.123797:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44419c8a80 x1871640291997824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935411.123805:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640291997824:0@lo:400: 00000100:00100000:2.0:1784935411.124433:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935411.124477:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291998080 00000100:00100000:2.0:1784935411.124484:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291998080 00000100:00100000:2.0:1784935411.124513:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291997952 00000100:00100000:2.0:1784935411.124515:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291997952 00000100:00100000:2.0:1784935411.124527:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935411.124533:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640291998080:12345-0@lo:13: 00002000:00000024:2.0:1784935411.124559:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935411.124597:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640291998080:12345-0@lo:13: Request processed in 64us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935411.124603:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935411.124616:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784935411.124621:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640291997952:12345-0@lo:13: 00002000:00000024:2.0:1784935411.124630:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935411.124655:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640291997952:12345-0@lo:13: Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935411.124661:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784935411.124690:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4581d94380 x1871640291997952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935411.124706:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640291997952:0@lo:13: 00010000:00080000:2.0:1784935411.124717:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4581d94000 x1871640291998080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935411.124727:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640291998080:0@lo:13: 00000100:00100000:3.0:1784935411.629780:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640291998208:0@lo:41: 00000100:00100000:3.0:1784935411.629849:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935411.629963:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291998208 00000100:00100000:0.0:1784935411.629971:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291998208 00000100:00100000:0.0:1784935411.630019:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784935411.630031:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640291998208:12345-0@lo:41: 00000004:00000024:0.0:1784935411.630073:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1784935411.630137:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640291998208:12345-0@lo:41: Request processed in 109us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935411.630144:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784935411.630338:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640291998208:0@lo:41: 00000001:00080000:2.0:1784935411.632834:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1784935411.824073:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935412.849284:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935413.869300:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935414.190462:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935414.190484:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291998336:0@lo:41: 00000100:00100000:1.0:1784935414.190549:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.193825:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291998336 00000100:00100000:0.0:1784935414.193838:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291998336 00000100:00100000:0.0:1784935414.193894:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784935414.193904:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640291998336:12345-0@lo:41: 00000004:00000024:0.0:1784935414.194181:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1784935414.194795:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640291998336:12345-0@lo:41: Request processed in 890us (4242us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.194804:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784935414.194887:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640291998336:0@lo:41: 00000020:01000004:1.0:1784935414.269712:0:9516:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784935414.269716:0:9516:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1784935414.269723:0:9516:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1784935414.269857:0:9516:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d457d24e000 00000020:01000004:1.0:1784935414.269873:0:9516:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784935414.269886:0:9516:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784935414.269899:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d44420999c0) 00000020:00000080:1.0:1784935414.269973:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784935414.302373:0:9516:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1784935414.302536:0:9516:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1784935414.319646:0:9516:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784935414.319849:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784935414.319866:0:9516:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784935414.319878:0:9516:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x857e02f4e0b163e1 00000020:01000004:2.0:1784935414.319884:0:9516:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1784935414.319904:0:9516:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.128@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784935414.319908:0:9516:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784935414.319914:0:9516:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784935414.320002:0:9516:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1784935414.320006:0:9516:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.128@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1784935414.331595:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784935414.331630:0:9516:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.128@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1784935414.331635:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784935414.331637:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784935414.331638:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935414.331639:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935414.331640:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935414.331642:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935414.331643:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784935414.331645:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784935414.331646:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784935414.331648:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935414.331649:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784935414.331653:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1784935414.331655:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784935414.331657:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784935414.331658:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935414.331659:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935414.331661:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935414.331662:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935414.331663:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784935414.331664:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784935414.331665:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784935414.331667:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935414.331668:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784935414.331693:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784935414.331711:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640291998464:0@lo:253: 00000100:00100000:2.0:1784935414.331781:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935414.331899:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935414.332032:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291998464 00000100:00100000:3.0:1784935414.332039:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291998464 00000100:00100000:3.0:1784935414.332121:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784935414.332136:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:9516:x1871640291998464:12345-0@lo:253: 20000000:01000000:3.0:1784935414.332165:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784935414.332169:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1784935414.332173:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1784935414.332176:0:6517:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1784935414.332392:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784935414.332507:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1784935414.332522:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1784935414.332538:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1784935414.332545:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1784935414.332558:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1784935414.332575:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1784935414.332658:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1784935414.332671:0:6517:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.128@tcp 20000000:01000000:3.0:1784935414.332673:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.128@tcp (null) (null) (null) 00000040:00080000:3.0:1784935414.332689:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1784935414.332695:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784935414.332709:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1784935414.332715:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.128@tcp (null) (null) 00000040:00080000:3.0:1784935414.332727:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1784935414.332733:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1784935414.332747:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1784935414.332763:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1784935414.332834:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1784935414.332845:0:6517:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.128@tcp 20000000:01000000:3.0:1784935414.332847:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.128@tcp (null) (null) (null) 00000040:00080000:3.0:1784935414.332863:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1784935414.332868:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784935414.332881:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1784935414.332886:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.128@tcp (null) (null) 00000040:00080000:3.0:1784935414.332898:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1784935414.332914:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1784935414.332953:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1784935414.332972:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1784935414.333338:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1784935414.333349:0:6517:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.128@tcp 20000000:01000000:3.0:1784935414.333351:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.128@tcp (null) (null) (null) 00000040:00080000:3.0:1784935414.333364:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1784935414.333369:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784935414.333381:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1784935414.333385:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.128@tcp (null) (null) 00000040:00080000:3.0:1784935414.333398:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1784935414.333403:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1784935414.333415:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1784935414.333429:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1784935414.333442:0:6517:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784935414.333444:0:6517:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784935414.333447:0:6517:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784935414.333486:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784935414.333488:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784935414.334471:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1784935414.334508:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1784935414.334519:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1784935414.334725:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1784935414.334745:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1784935414.334759:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1784935414.334767:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1784935414.334769:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784935414.336554:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1784935414.336666:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1784935414.336688:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1784935414.336700:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1784935414.336710:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784935414.336712:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784935414.338566:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1784935414.338604:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1784935414.338619:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1784935414.339016:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1784935414.339038:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1784935414.339052:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1784935414.339070:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784935414.339072:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784935414.339546:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1784935414.339567:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1784935414.339581:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1784935414.339719:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1784935414.339740:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1784935414.339752:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1784935414.339761:0:6517:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1784935414.339763:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784935414.340251:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1784935414.340271:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1784935414.340284:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1784935414.340426:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1784935414.340447:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1784935414.340461:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:0.0:1784935414.340478:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784935414.340496:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.340513:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4540031000/0x857e02f4e0b162de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b162d7 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.340521:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d454166b000/0x857e02f4e0b16308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16301 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.340528:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4554021200/0x857e02f4e0b16347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16340 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.340536:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4541529800/0x857e02f4e0b16363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1635c expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.340542:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d454166b400/0x857e02f4e0b1638d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16386 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.340546:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b163a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b163a2 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.340550:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4554020200/0x857e02f4e0b163d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b163cc expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.340554:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.340589:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4554020200/0x857e02f4e0b163d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b163cc expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.340600:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4554020200/0x857e02f4e0b163d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b163cc expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.340611:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574334a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291998592:0@lo:104: 00000100:00100000:0.0:1784935414.340661:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784935414.341457:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b163a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b163a2 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.341469:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b163a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b163a2 expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.341479:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291998720:0@lo:104: 00000100:00100000:0.0:1784935414.341510:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784935414.341887:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d454166b400/0x857e02f4e0b1638d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16386 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.341897:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d454166b400/0x857e02f4e0b1638d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16386 expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.341918:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574334380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291998848:0@lo:104: 00000100:00100000:2.0:1784935414.341969:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291998592 00000100:00100000:2.0:1784935414.341977:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291998592 00000100:00100000:2.0:1784935414.342063:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291998720 00000100:00100000:2.0:1784935414.342067:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291998720 00000100:00100000:2.0:1784935414.342085:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784935414.342093:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6517:x1871640291998592:12345-0@lo:104: 00010000:00010000:2.0:1784935414.342107:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.342139:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784935414.342151:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784935414.342156:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6517:x1871640291998592:12345-0@lo:104: Request processed in 64us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935414.342163:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1784935414.342173:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4541529800/0x857e02f4e0b16363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b1635c expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.342177:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291998848 00000100:00100000:2.0:1784935414.342179:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291998848 00010000:00010000:0.0:1784935414.342182:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4541529800/0x857e02f4e0b16363 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b1635c expref: 21 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.342207:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574334700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291998976:0@lo:104: 00000100:00100000:0.0:1784935414.342241:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784935414.342259:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4554021200/0x857e02f4e0b16347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16340 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342267:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4554021200/0x857e02f4e0b16347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16340 expref: 21 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.342276:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574336d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291999104:0@lo:104: 00000100:00100000:0.0:1784935414.342296:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935414.342307:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291998976 00000100:00100000:2.0:1784935414.342310:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291998976 00010000:00010000:0.0:1784935414.342312:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d454166b000/0x857e02f4e0b16308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16301 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.342320:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291999104 00010000:00010000:0.0:1784935414.342320:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d454166b000/0x857e02f4e0b16308 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16301 expref: 21 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.342322:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291999104 00000100:00100000:0.0:1784935414.342328:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574334e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291999232:0@lo:104: 00000100:00100000:2.0:1784935414.342332:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784935414.342337:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:6517:x1871640291998720:12345-0@lo:104: 00010000:00010000:2.0:1784935414.342345:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.342348:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784935414.342363:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4540031000/0x857e02f4e0b162de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b162d7 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342371:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4540031000/0x857e02f4e0b162de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b162d7 expref: 21 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.342374:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784935414.342378:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:6517:x1871640291998720:12345-0@lo:104: Request processed in 41us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.342379:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291999360:0@lo:104: 00000100:00100000:2.0:1784935414.342389:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784935414.342395:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a000 going to sleep for 11 seconds 00000100:00100000:2.0:1784935414.342407:0:6509:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784935414.342414:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574334a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291998592:0@lo:104: 00000100:00100000:0.0:1784935414.342422:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291998720:0@lo:104: 00010000:00010000:0.0:1784935414.342442:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784935414.342447:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342454:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529000 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935414.342457:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342466:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935414.342473:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935414.342479:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935414.342507:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342513:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935414.342531:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342538:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4541529000/0x857e02f4e0b163cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b163d3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342549:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935414.342552:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342557:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528200 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935414.342559:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342571:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935414.342577:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935414.342581:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935414.342595:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342600:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935414.342605:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342610:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4541528200/0x857e02f4e0b163a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b163a9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342619:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935414.342621:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935414.342623:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935414.342635:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291999488:0@lo:103: 00000100:00100000:0.0:1784935414.342660:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.342682:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784935414.342687:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291999616:0@lo:103: 00000100:00100000:0.0:1784935414.342718:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.342749:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291999488 00000100:00100000:0.0:1784935414.342753:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291999488 00010000:00010000:0.0:1784935414.342769:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4554020200/0x857e02f4e0b163d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b163cc expref: 22 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.342800:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291999616 00000100:00100000:0.0:1784935414.342804:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291999616 00010000:00010000:0.0:1784935414.342816:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b163a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b163a2 expref: 23 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.342828:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784935414.342834:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:3651:x1871640291999488:12345-0@lo:103: 00010000:00010000:0.0:1784935414.342844:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935414.342849:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4554020200/0x857e02f4e0b163d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b163cc expref: 23 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342858:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4554020200/0x857e02f4e0b163d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b163cc expref: 23 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342871:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554020200/0x857e02f4e0b163d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b163cc expref: 23 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.342884:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935414.342947:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:3651:x1871640291999488:12345-0@lo:103: Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.342954:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784935414.342969:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784935414.342975:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3651:x1871640291999616:12345-0@lo:103: 00000100:00100000:2.0:1784935414.342978:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784935414.342983:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784935414.342988:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291999232 00010000:00010000:0.0:1784935414.342988:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b163a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b163a2 expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.342990:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291999232 00010000:00010000:0.0:1784935414.342997:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b163a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b163a2 expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.343004:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291999360 00000100:00100000:2.0:1784935414.343006:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291999360 00010000:00010000:0.0:1784935414.343013:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541529e00/0x857e02f4e0b163a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b163a2 expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343022:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935414.343029:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784935414.343034:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+7:6517:x1871640291998848:12345-0@lo:104: 00010000:00010000:2.0:1784935414.343042:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.343044:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3651:x1871640291999616:12345-0@lo:103: Request processed in 69us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.343050:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1784935414.343077:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935414.343080:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291999616:0@lo:103: 00000100:00100000:2.0:1784935414.343082:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+7:6517:x1871640291998848:12345-0@lo:104: Request processed in 48us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.343087:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640291999488:0@lo:103: 00000100:00100000:2.0:1784935414.343088:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784935414.343100:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1784935414.343103:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784935414.343105:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:6517:x1871640291998976:12345-0@lo:104: 00010000:00010000:0.0:1784935414.343107:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.343113:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343113:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528400 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935414.343116:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343123:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935414.343130:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935414.343135:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935414.343137:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784935414.343141:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:6517:x1871640291998976:12345-0@lo:104: Request processed in 36us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935414.343146:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1784935414.343147:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343153:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784935414.343157:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784935414.343162:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:6517:x1871640291999104:12345-0@lo:104: 00010000:00010000:0.0:1784935414.343173:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.343176:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343180:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1638d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343188:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935414.343191:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343197:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166ac00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935414.343199:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343206:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935414.343212:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.343226:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:0.0:1784935414.343227:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1784935414.343230:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:6517:x1871640291999104:12345-0@lo:104: Request processed in 68us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935414.343236:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1784935414.343239:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343244:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784935414.343247:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1784935414.343249:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.343253:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457e80f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6517:x1871640291999232:12345-0@lo:104: 00010000:00010000:0.0:1784935414.343256:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166ac00/0x857e02f4e0b1635c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16363 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.343259:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343265:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935414.343273:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343278:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166a200 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935414.343281:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.343283:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784935414.343287:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457e80f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:6517:x1871640291999232:12345-0@lo:104: Request processed in 35us (938us total) trans 0 rc 0/0 00010000:00010000:0.0:1784935414.343289:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.343292:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 10000000:00010000:0.0:1784935414.343295:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935414.343300:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935414.343311:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.343315:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1784935414.343317:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784935414.343320:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6517:x1871640291999360:12345-0@lo:104: 00010000:00010000:2.0:1784935414.343326:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343327:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343333:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166a200/0x857e02f4e0b16340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16347 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343342:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935414.343345:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.343349:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1784935414.343350:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166b800 already unused, calling callback (ffffffffc12b4c20) 00000100:00100000:2.0:1784935414.343354:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6517:x1871640291999360:12345-0@lo:104: Request processed in 33us (376us total) trans 0 rc 0/0 10000000:00010000:0.0:1784935414.343354:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.343360:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1784935414.343370:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935414.343375:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935414.343381:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935414.343393:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343399:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935414.343405:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343411:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16308 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343421:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935414.343424:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343429:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020c00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935414.343432:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343437:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935414.343443:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935414.343454:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935414.343467:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343472:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935414.343476:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343482:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4554020c00/0x857e02f4e0b162d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b162de expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343494:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935414.343496:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935414.343497:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935414.343509:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291999744:0@lo:103: 00000100:00100000:0.0:1784935414.343536:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.343563:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292000256:0@lo:103: 00000100:00100000:0.0:1784935414.343584:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.343599:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784935414.343604:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291999872:0@lo:103: 00000100:00100000:0.0:1784935414.343623:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.343649:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291999744 00000100:00100000:0.0:1784935414.343654:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291999744 00010000:00010000:0.0:1784935414.343668:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d454166b400/0x857e02f4e0b1638d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16386 expref: 20 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.343681:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292000256 00000100:00100000:0.0:1784935414.343683:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292000256 00010000:00010000:0.0:1784935414.343701:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4540031000/0x857e02f4e0b162de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b162d7 expref: 21 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.343712:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640291999872 00000100:00100000:0.0:1784935414.343715:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640291999872 00010000:00010000:0.0:1784935414.343723:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4541529800/0x857e02f4e0b16363 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1635c expref: 22 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.343734:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784935414.343739:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:3649:x1871640291999744:12345-0@lo:103: 00010000:00010000:0.0:1784935414.343746:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784935414.343749:0:6510:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1784935414.343750:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d454166b400/0x857e02f4e0b1638d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16386 expref: 22 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.343756:0:6510:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1784935414.343759:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d454166b400/0x857e02f4e0b1638d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16386 expref: 22 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343770:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935414.343797:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:3649:x1871640291999744:12345-0@lo:103: Request processed in 58us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.343802:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784935414.343814:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784935414.343819:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45729c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3649:x1871640292000256:12345-0@lo:103: 00010000:00010000:0.0:1784935414.343826:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935414.343830:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4540031000/0x857e02f4e0b162de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b162d7 expref: 21 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343837:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4540031000/0x857e02f4e0b162de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b162d7 expref: 21 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343857:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935414.343880:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45729c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3649:x1871640292000256:12345-0@lo:103: Request processed in 61us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.343886:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784935414.343913:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784935414.343917:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3649:x1871640291999872:12345-0@lo:103: 00010000:00010000:0.0:1784935414.343923:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935414.343945:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4541529800/0x857e02f4e0b16363 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1635c expref: 20 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343953:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4541529800/0x857e02f4e0b16363 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b1635c expref: 20 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.343962:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935414.343983:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3649:x1871640291999872:12345-0@lo:103: Request processed in 65us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.343988:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784935414.344006:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292000128:0@lo:103: 00000100:00100000:0.0:1784935414.344027:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.344050:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784935414.344056:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292000000:0@lo:103: 00000100:00100000:0.0:1784935414.344073:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.344091:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292000128 00000100:00100000:0.0:1784935414.344094:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292000128 00010000:00010000:0.0:1784935414.344107:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d454166b000/0x857e02f4e0b16308 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16301 expref: 20 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.344119:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292000000 00000100:00100000:0.0:1784935414.344127:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292000000 00010000:00010000:0.0:1784935414.344139:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4554021200/0x857e02f4e0b16347 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16340 expref: 21 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.344152:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784935414.344157:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3652:x1871640292000128:12345-0@lo:103: 00010000:00010000:0.0:1784935414.344163:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935414.344166:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d454166b000/0x857e02f4e0b16308 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16301 expref: 21 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344173:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d454166b000/0x857e02f4e0b16308 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16301 expref: 21 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344182:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935414.344209:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3652:x1871640292000128:12345-0@lo:103: Request processed in 51us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.344215:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784935414.344238:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784935414.344243:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3652:x1871640292000000:12345-0@lo:103: 00010000:00010000:0.0:1784935414.344250:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935414.344254:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4554021200/0x857e02f4e0b16347 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16340 expref: 20 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344262:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4554021200/0x857e02f4e0b16347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16340 expref: 20 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344273:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344282:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344300:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344306:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344313:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344320:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344325:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935414.344329:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344336:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344344:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344353:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935414.344376:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3652:x1871640292000000:12345-0@lo:103: Request processed in 133us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.344383:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784935414.344411:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292000000:0@lo:103: 00000100:00100000:0.0:1784935414.344419:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292000128:0@lo:103: 00000100:00100000:0.0:1784935414.344442:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291999872:0@lo:103: 00000100:00100000:0.0:1784935414.344459:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640291999744:0@lo:103: 00000100:00100000:0.0:1784935414.344465:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292000256:0@lo:103: 00010000:00010000:0.0:1784935414.344494:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166b400/0x857e02f4e0b1638d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16386 expref: 19 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.344506:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574334380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291998848:0@lo:104: 00010000:00010000:0.0:1784935414.344515:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541529800/0x857e02f4e0b16363 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b1635c expref: 18 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.344523:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574334700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291998976:0@lo:104: 00010000:00010000:0.0:1784935414.344531:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554021200/0x857e02f4e0b16347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16340 expref: 17 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.344539:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574336d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291999104:0@lo:104: 00010000:00010000:0.0:1784935414.344546:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166b000/0x857e02f4e0b16308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16301 expref: 16 pid: 6520 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.344553:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574334e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291999232:0@lo:104: 00010000:00010000:0.0:1784935414.344561:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540031000/0x857e02f4e0b162de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b162d7 expref: 15 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.344569:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1871640291999360:0@lo:104: 00010000:00010000:0.0:1784935414.344590:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344599:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344617:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.344623:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540030600/0x857e02f4e0b163e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784935414.344635:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1784935414.344729:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935414.350124:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:9516:x1871640291998464:12345-0@lo:253: Request processed in 17980us (18334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935414.350152:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784935414.350360:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640291998464:0@lo:253: 10000000:01000000:1.0:1784935414.350375:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784935414.350378:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784935414.350380:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784935414.350381:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935414.350382:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1784935414.350383:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935414.350384:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935414.350386:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784935414.350387:0:9516:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784935414.350389:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935414.350390:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784935414.350411:0:9516:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d457d24e000 from lustre-OST0001 10000000:01000000:1.0:1784935414.350439:0:9516:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1784935414.350442:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784935414.350450:0:9516:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d4572a3b380 local copy 10000000:01000000:1.0:1784935414.350454:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784935414.350496:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.350507:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.350516:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935414.350534:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292000384:0@lo:101: 00000100:00100000:1.0:1784935414.350568:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935414.350607:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f9d240 going to sleep for 11 seconds 00000100:00100000:2.0:1784935414.350669:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292000384 00000100:00100000:2.0:1784935414.350675:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292000384 00000100:00100000:2.0:1784935414.350716:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784935414.350725:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:9516:x1871640292000384:12345-0@lo:101: 00010000:00010000:2.0:1784935414.350737:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935414.350750:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d300400/0x857e02f4e0b163f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b163ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.350772:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d300400/0x857e02f4e0b163f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b163ef expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.350782:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d300400/0x857e02f4e0b163f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b163ef expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.350790:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300400, rc 0) 00000100:00100000:2.0:1784935414.350903:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292000384:12345-0@lo:101: Request processed in 179us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935414.350909:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784935414.351110:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292000384:0@lo:101: 00010000:00010000:3.0:1784935414.351123:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935414.351131:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935414.351224:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292000512:0@lo:501: 00000100:00100000:3.0:1784935414.351254:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935414.351283:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f03840 going to sleep for 11 seconds 00000100:00100000:2.0:1784935414.351294:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292000512 00000100:00100000:2.0:1784935414.351298:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292000512 00000100:00100000:2.0:1784935414.351330:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784935414.351337:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292000512:12345-0@lo:501: 00000100:00100000:2.0:1784935414.351408:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292000512:12345-0@lo:501: Request processed in 72us (154us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784935414.351486:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1784935414.352151:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292000512:0@lo:501: 10000000:01000000:1.0:1784935414.352170:0:9516:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784935414.352197:0:9516:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784935414.352203:0:9516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.352213:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.352230:0:9516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.352245:0:9516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784935414.352270:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d457d24e000 10000000:01000000:1.0:1784935414.352275:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784935414.352281:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784935414.352284:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784935414.352288:0:9516:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1784935414.352301:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784935414.352321:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.352329:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.352338:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935414.352352:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292000640:0@lo:101: 00000100:00100000:1.0:1784935414.352395:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935414.352432:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f9d240 going to sleep for 11 seconds 00000100:00100000:3.0:1784935414.352714:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292000640 00000100:00100000:3.0:1784935414.352719:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292000640 00000100:00100000:3.0:1784935414.352765:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784935414.352773:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292000640:12345-0@lo:101: 00010000:00010000:3.0:1784935414.352784:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935414.352795:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554020a00/0x857e02f4e0b16404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b163fd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935414.352815:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554020a00/0x857e02f4e0b16404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b163fd expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935414.352824:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554020a00/0x857e02f4e0b16404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b163fd expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935414.352842:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020a00, rc 0) 00000100:00100000:3.0:1784935414.352880:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9516:x1871640292000640:12345-0@lo:101: Request processed in 108us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.352886:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784935414.352942:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292000640:0@lo:101: 00010000:00010000:0.0:1784935414.353162:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935414.353169:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.353176:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166ae00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935414.353179:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.353187:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935414.353194:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935414.353200:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935414.353229:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.353236:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935414.353260:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.353268:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b163ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x857e02f4e0b163f6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.353287:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935414.353289:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935414.353291:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935414.353299:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784935414.353311:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292000768:0@lo:103: 00000100:00100000:0.0:1784935414.353342:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.353373:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292000768 00000100:00100000:0.0:1784935414.353377:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292000768 00000100:00100000:0.0:1784935414.353409:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784935414.353415:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3649:x1871640292000768:12345-0@lo:103: 00010000:00010000:0.0:1784935414.353424:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935414.353435:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d300400/0x857e02f4e0b163f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b163ef expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.353446:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935414.353473:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:3649:x1871640292000768:12345-0@lo:103: Request processed in 58us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.353479:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784935414.353504:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292000768:0@lo:103: 00010000:00010000:3.0:1784935414.353598:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935414.353607:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935414.353681:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292000896:0@lo:501: 00000100:00100000:3.0:1784935414.353706:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935414.353719:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935414.353801:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292000896 00000100:00100000:0.0:1784935414.353805:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292000896 00000100:00100000:0.0:1784935414.353877:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784935414.353884:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292000896:12345-0@lo:501: 00000100:00100000:0.0:1784935414.354014:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292000896:12345-0@lo:501: Request processed in 130us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.354020:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784935414.354094:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292000896:0@lo:501: 00000100:00100000:3.0:1784935414.354120:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001024:0@lo:503: 00000100:00100000:3.0:1784935414.354157:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935414.354666:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292001024 00000100:00100000:2.0:1784935414.354672:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292001024 00000100:00100000:3.0:1784935414.354712:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784935414.354725:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292001024:12345-0@lo:503: 00000100:00100000:3.0:1784935414.354800:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292001024:12345-0@lo:503: Request processed in 79us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.355346:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784935414.355427:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935414.355448:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001024:0@lo:503: 00000040:00080000:2.0:1784935414.355685:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784935414.357092:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001152:0@lo:502: 00000100:00100000:2.0:1784935414.357291:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935414.357336:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935414.357414:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292001152 00000100:00100000:0.0:1784935414.357421:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292001152 00000100:00100000:0.0:1784935414.357472:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784935414.357481:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292001152:12345-0@lo:502: 00000100:00100000:0.0:1784935414.357694:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292001152:12345-0@lo:502: Request processed in 214us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.357701:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784935414.358431:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001152:0@lo:502: 00000040:00080000:0.0:1784935414.358824:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1784935414.358855:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1784935414.358870:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1784935414.358884:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1784935414.359124:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1784935414.359142:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1784935414.359181:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001280:0@lo:502: 00000100:00100000:0.0:1784935414.359318:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.359400:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935414.359602:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292001280 00000100:00100000:3.0:1784935414.359609:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292001280 00000100:00100000:3.0:1784935414.359747:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784935414.359763:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292001280:12345-0@lo:502: 00000100:00100000:3.0:1784935414.359878:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292001280:12345-0@lo:502: Request processed in 115us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.359884:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784935414.360030:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001280:0@lo:502: 00000040:00080000:0.0:1784935414.360082:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1784935414.360092:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1784935414.360701:0:9528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784935414.360709:0:9528:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1784935414.360715:0:9528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935414.360716:0:9528:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1784935414.360724:0:9528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784935414.360751:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d4581ed8000) 00000020:00000080:0.0:1784935414.360774:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1784935414.360781:0:9528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784935414.360847:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457d24e000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1784935414.360856:0:9528:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784935414.360862:0:9528:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x857e02f4e0b16412 00010000:00010000:0.0:1784935414.366383:0:9528:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1784935414.366721:0:9528:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1784935414.370069:0:9528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1784935414.370678:0:9528:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1784935414.380750:0:9528:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1784935414.381278:0:9528:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1784935414.393476:0:9528:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1784935414.394893:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1784935414.394902:0:9528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935414.394908:0:9528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935414.394910:0:9528:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1784935414.394913:0:9528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784935414.394917:0:9528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935414.394918:0:9528:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784935414.394921:0:9528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784935414.394923:0:9528:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784935414.396817:0:9528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935414.396824:0:9528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935414.396826:0:9528:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784935414.396831:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1784935414.397438:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1784935414.397469:0:9516:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784935414.397524:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.397537:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935414.397545:0:9516:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457d24e000 from 1 10000000:01000000:2.0:1784935414.397547:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784935414.397583:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.397591:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.397602:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.397623:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001408:0@lo:101: 00000100:00100000:2.0:1784935414.397688:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935414.397735:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935414.397797:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292001408 00000100:00100000:1.0:1784935414.397804:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292001408 00000100:00100000:1.0:1784935414.397853:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784935414.397863:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:9516:x1871640292001408:12345-0@lo:101: 00010000:00010000:1.0:1784935414.397879:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935414.397891:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b16420 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16419 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.397915:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b16420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16419 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.398115:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b16420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16419 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.398133:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d454166aa00, rc 0) 00000100:00100000:1.0:1784935414.398179:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9516:x1871640292001408:12345-0@lo:101: Request processed in 317us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935414.398184:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784935414.398285:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001408:0@lo:101: 00010000:00010000:2.0:1784935414.398306:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.398314:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.398392:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001536:0@lo:501: 00000100:00100000:2.0:1784935414.398415:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935414.398442:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935414.398506:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292001536 00000100:00100000:1.0:1784935414.398510:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292001536 00000100:00100000:1.0:1784935414.398529:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784935414.398534:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9516:x1871640292001536:12345-0@lo:501: 00000100:00100000:1.0:1784935414.398621:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9516:x1871640292001536:12345-0@lo:501: Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935414.398629:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784935414.398698:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001536:0@lo:501: 00000100:00100000:2.0:1784935414.398723:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001664:0@lo:503: 00000100:00100000:2.0:1784935414.398759:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935414.398780:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935414.399108:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292001664 00000100:00100000:1.0:1784935414.399113:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292001664 00000100:00100000:1.0:1784935414.399146:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784935414.399152:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9516:x1871640292001664:12345-0@lo:503: 00000100:00100000:1.0:1784935414.399312:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9516:x1871640292001664:12345-0@lo:503: Request processed in 160us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935414.399319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784935414.399407:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001664:0@lo:503: 00000040:00080000:2.0:1784935414.399643:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784935414.399714:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001792:0@lo:502: 00000100:00100000:2.0:1784935414.399752:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935414.399775:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292001792 00000100:00100000:2.0:1784935414.399779:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292001792 00000100:00100000:2.0:1784935414.400259:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784935414.400270:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9516:x1871640292001792:12345-0@lo:502: 00000100:00100000:2.0:1784935414.400357:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9516:x1871640292001792:12345-0@lo:502: Request processed in 89us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935414.400363:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784935414.400788:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70600 going to sleep for 11 seconds 00000100:00100000:2.0:1784935414.400806:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001792:0@lo:502: 00000040:00080000:2.0:1784935414.401165:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1784935414.401310:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1784935414.401340:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001920:0@lo:502: 00000100:00100000:2.0:1784935414.401386:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935414.401449:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70600 going to sleep for 11 seconds 00000100:00100000:1.0:1784935414.401497:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292001920 00000100:00100000:1.0:1784935414.401504:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292001920 00000100:00100000:1.0:1784935414.401581:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784935414.401589:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9516:x1871640292001920:12345-0@lo:502: 00000100:00100000:1.0:1784935414.401684:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9516:x1871640292001920:12345-0@lo:502: Request processed in 95us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935414.401690:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784935414.401801:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292001920:0@lo:502: 00000040:00080000:0.0:1784935414.401843:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784935414.401851:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1784935414.407378:0:9532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935414.407389:0:9532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935414.407391:0:9532:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784935414.407398:0:9532:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d457d24e000 00000020:00000080:1.0:1784935414.407400:0:9532:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935414.407411:0:9532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935414.407413:0:9532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935414.407414:0:9532:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784935414.407417:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1784935414.407555:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784935414.407585:0:9516:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784935414.407606:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.407619:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935414.407668:0:9516:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784935414.407671:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d457d24e000 10000000:01000000:2.0:1784935414.407673:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d457d24e000 10000000:01000000:2.0:1784935414.407677:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784935414.407682:0:9516:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d457d24e000 from 1 10000000:01000000:2.0:1784935414.407684:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784935414.407715:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.407724:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.407734:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.407753:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292002048:0@lo:101: 00000100:00100000:2.0:1784935414.407809:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935414.407901:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935414.408722:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292002048 00000100:00100000:3.0:1784935414.408730:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292002048 00000100:00100000:3.0:1784935414.408828:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784935414.408838:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9516:x1871640292002048:12345-0@lo:101: 00010000:00010000:3.0:1784935414.408852:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935414.408867:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554021200/0x857e02f4e0b1642e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16427 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935414.408897:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554021200/0x857e02f4e0b1642e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16427 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935414.408906:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554021200/0x857e02f4e0b1642e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16427 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935414.408914:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021200, rc 0) 00000100:00100000:3.0:1784935414.409005:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9516:x1871640292002048:12345-0@lo:101: Request processed in 169us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.409012:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784935414.409106:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292002048:0@lo:101: 00010000:00010000:1.0:1784935414.409121:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.409130:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935414.409245:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292002176:0@lo:501: 00000100:00100000:1.0:1784935414.409279:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935414.414027:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f9da80 going to sleep for 11 seconds 00000100:00100000:2.0:1784935414.414154:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292002176 00000100:00100000:2.0:1784935414.414163:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292002176 00000100:00100000:2.0:1784935414.414281:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784935414.414290:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9516:x1871640292002176:12345-0@lo:501: 00000100:00100000:2.0:1784935414.414460:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9516:x1871640292002176:12345-0@lo:501: Request processed in 161us (5169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935414.414468:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784935414.415078:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292002176:0@lo:501: 00000100:00100000:1.0:1784935414.415130:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292002304:0@lo:503: 00000100:00100000:1.0:1784935414.415252:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935414.415278:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f9da80 going to sleep for 11 seconds 00000100:00100000:3.0:1784935414.415329:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292002304 00000100:00100000:3.0:1784935414.415335:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292002304 00000100:00100000:3.0:1784935414.415363:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784935414.415371:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9516:x1871640292002304:12345-0@lo:503: 00000100:00100000:3.0:1784935414.415466:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9516:x1871640292002304:12345-0@lo:503: Request processed in 95us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.415483:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784935414.415612:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292002304:0@lo:503: 00000040:00080000:1.0:1784935414.415858:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784935414.415920:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292002432:0@lo:502: 00000100:00100000:1.0:1784935414.416061:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935414.416084:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f9da80 going to sleep for 11 seconds 00000100:00100000:3.0:1784935414.416277:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292002432 00000100:00100000:3.0:1784935414.416282:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292002432 00000100:00100000:3.0:1784935414.416316:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784935414.416324:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9516:x1871640292002432:12345-0@lo:502: 00000100:00100000:3.0:1784935414.416408:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9516:x1871640292002432:12345-0@lo:502: Request processed in 84us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.416414:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784935414.416519:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292002432:0@lo:502: 00000040:00080000:1.0:1784935414.416686:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784935414.416711:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784935414.416726:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784935414.416741:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784935414.416754:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784935414.416765:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784935414.416776:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784935414.416788:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784935414.416813:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784935414.417122:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784935414.417144:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784935414.417158:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784935414.417171:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784935414.417183:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784935414.417272:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784935414.417284:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784935414.417295:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784935414.417306:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784935414.417316:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784935414.417328:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784935414.417340:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784935414.417354:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784935414.417367:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784935414.417379:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784935414.417404:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1784935414.417419:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1784935414.417431:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1784935414.417443:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1784935414.417454:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1784935414.417466:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1784935414.417478:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1784935414.417501:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1784935414.417513:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1784935414.417525:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1784935414.417537:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1784935414.417549:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1784935414.417564:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1784935414.417575:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1784935414.417587:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1784935414.417599:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1784935414.417621:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1784935414.417632:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1784935414.417644:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1784935414.417657:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1784935414.417671:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1784935414.417685:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1784935414.417717:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292002560:0@lo:502: 00000100:00100000:1.0:1784935414.417769:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935414.417843:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f9da80 going to sleep for 11 seconds 00000100:00100000:0.0:1784935414.417914:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292002560 00000100:00100000:0.0:1784935414.417919:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292002560 00000100:00100000:3.0:1784935414.418373:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784935414.418383:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9516:x1871640292002560:12345-0@lo:502: 00000100:00100000:3.0:1784935414.418524:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9516:x1871640292002560:12345-0@lo:502: Request processed in 144us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.418532:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784935414.418747:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292002560:0@lo:502: 00000040:00080000:1.0:1784935414.418801:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1784935414.418810:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1784935414.419561:0:9533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784935414.419577:0:9533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d457e88cd40) 00000020:00000080:2.0:1784935414.419598:0:9533:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1784935414.419801:0:9533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457d24e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784935414.419806:0:9533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d457d24e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784935414.419808:0:9533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457d24e000 3 00010000:00080000:2.0:1784935414.419836:0:9533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d44430bd800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.128@tcp at head 00010000:00010000:2.0:1784935414.422114:0:9533:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1784935414.422287:0:9533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784935414.422330:0:9533:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784935414.422343:0:9533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x857e02f4e0b1643c 00000100:00080000:2.0:1784935414.422353:0:9533:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784935414.422360:0:9533:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d44430bd800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935414.422397:0:9533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4581d94000 x1871640292002688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935414.422425:0:9533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784935414.422588:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1871640292002688:0@lo:38: 00000100:00100000:1.0:1784935414.422658:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935414.422769:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292002688 00000100:00100000:2.0:1784935414.422776:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292002688 00000100:00100000:2.0:1784935414.422807:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784935414.422813:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1871640292002688:12345-0@lo:38: 00010000:00080000:2.0:1784935414.422834:0:7797:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:2.0:1784935414.422869:0:7797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x857e02f4e0b16443 00000004:00100000:2.0:1784935414.422881:0:7797:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784935414.422911:0:7797:0:(import.c:65:import_set_state_nolock()) ffff8d44430ba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784935414.423062:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871640292002688:12345-0@lo:38: Request processed in 247us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935414.423069:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784935414.423111:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4581d94000 x1871640292002688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935414.423121:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784935414.423128:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1784935414.423134:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784935414.423138:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784935414.423141:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44430bd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784935414.423147:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1871640292002688:0@lo:38: 00000100:00100000:2.0:1784935414.426163:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292002816:0@lo:400: 00000100:00100000:2.0:1784935414.426301:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.426546:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292002944:0@lo:400: 00000100:00100000:0.0:1784935414.426577:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.426618:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292002816 00000100:00100000:0.0:1784935414.426625:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292002816 00000100:00100000:0.0:1784935414.426665:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292002944 00000100:00100000:0.0:1784935414.426668:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292002944 00000100:00100000:0.0:1784935414.426685:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935414.426692:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292002816:12345-0@lo:400: 00000100:00100000:1.0:1784935414.428147:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784935414.428160:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292002944:12345-0@lo:400: 00000100:00100000:1.0:1784935414.428245:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292002944:12345-0@lo:400: Request processed in 88us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935414.428253:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784935414.428537:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292003200:0@lo:400: 00000100:00100000:3.0:1784935414.428575:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935414.428600:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784935414.428606:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292003072:0@lo:400: 00000100:00100000:3.0:1784935414.428631:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935414.428648:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292003584:0@lo:400: 00000100:00100000:3.0:1784935414.428670:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935414.428696:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292003072 00000100:00100000:3.0:1784935414.428702:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292003072 00000100:00100000:3.0:1784935414.428737:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784935414.428744:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292003072:12345-0@lo:400: 00000100:00100000:3.0:1784935414.428782:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292003072:12345-0@lo:400: Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.428797:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784935414.428817:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292003584 00000100:00100000:3.0:1784935414.428820:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292003584 00000100:00100000:3.0:1784935414.428852:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784935414.428859:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292003584:12345-0@lo:400: 00000100:00100000:3.0:1784935414.428890:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292003584:12345-0@lo:400: Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.428896:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784935414.429091:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292003072:0@lo:400: 00010000:00080000:3.0:1784935414.429110:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44423cd180 x1871640292003584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935414.429118:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1784935414.429131:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292003584:0@lo:400: 00000100:00080000:3.0:1784935414.429147:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935414.429170:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292003200 00000100:00100000:3.0:1784935414.429173:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292003200 00000100:00100000:3.0:1784935414.429230:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784935414.429238:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292003200:12345-0@lo:400: 00000100:00100000:3.0:1784935414.429273:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292003200:12345-0@lo:400: Request processed in 35us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.429279:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1784935414.429305:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44423cdf80 x1871640292003200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935414.429313:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292003200:0@lo:400: 00000100:00080000:1.0:1784935414.429420:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935414.429685:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292002816:12345-0@lo:400: Request processed in 2991us (3384us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.429699:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935414.429726:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292003456:0@lo:400: 00000100:00100000:0.0:1784935414.429757:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784935414.429792:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44423cce00 x1871640292002944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935414.429801:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292002944:0@lo:400: 00000100:00100000:0.0:1784935414.429812:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784935414.429817:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292003328:0@lo:400: 00000100:00100000:0.0:1784935414.429837:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.429863:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292003328 00000100:00100000:0.0:1784935414.429867:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292003328 00000100:00100000:0.0:1784935414.429894:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784935414.429900:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292003328:12345-0@lo:400: 00000100:00100000:0.0:1784935414.430086:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292003328:12345-0@lo:400: Request processed in 51us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.430095:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1784935414.430122:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44423ce300 x1871640292003328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935414.430132:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292003328:0@lo:400: 00000100:00080000:0.0:1784935414.430145:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935414.430287:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292003456 00000100:00100000:3.0:1784935414.430297:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292003456 00000100:00100000:3.0:1784935414.430340:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784935414.430345:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292003456:12345-0@lo:400: 00000100:00100000:3.0:1784935414.430386:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292003456:12345-0@lo:400: Request processed in 40us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.430393:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1784935414.430439:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784935414.430746:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44423ced80 x1871640292003456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935414.430756:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292003456:0@lo:400: 00010000:00080000:2.0:1784935414.430829:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44423cdc00 x1871640292002816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935414.430840:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292002816:0@lo:400: 00000020:01000004:2.0:1784935414.431041:0:9533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784935414.431055:0:9533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d457e88b380) 00000020:00000080:2.0:1784935414.431076:0:9533:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1784935414.433115:0:9533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457d24e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784935414.433124:0:9533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d457d24e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784935414.433127:0:9533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457d24e000 3 00010000:00080000:2.0:1784935414.433160:0:9533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d44430bf000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.128@tcp at head 00000100:00100000:3.0:1784935414.435058:0:9535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9535:1871640292003712:0@lo:901: 00000100:00100000:3.0:1784935414.435132:0:9535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935414.435165:0:9535:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44421fcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784935414.438098:0:6536:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292003712 00000100:00100000:0.0:1784935414.438119:0:6536:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292003712 00000100:00100000:0.0:1784935414.438183:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784935414.438264:0:6536:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1871640292003712:12345-0@lo:901: 00000100:00100000:0.0:1784935414.438396:0:6536:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1871640292003712:12345-0@lo:901: Request processed in 135us (3264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.438404:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1784935414.438427:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784935414.438469:0:9535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d44419c9880 x1871640292003712/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784935430 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935414.438483:0:9535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9535:1871640292003712:0@lo:901: 00010000:00010000:2.0:1784935414.441175:0:9533:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1784935414.441351:0:9533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1784935414.441395:0:9533:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784935414.441406:0:9533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x857e02f4e0b16451 00000100:00080000:2.0:1784935414.441416:0:9533:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784935414.441421:0:9533:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d44430bf000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935414.441454:0:9533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4581d96d80 x1871640292003840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935414.441507:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1871640292003840:0@lo:38: 00000100:00100000:0.0:1784935414.441571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784935414.441873:0:9533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1784935414.442094:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292003840 00000100:00100000:2.0:1784935414.442101:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292003840 00000100:00100000:2.0:1784935414.442139:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784935414.442145:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1871640292003840:12345-0@lo:38: 00010000:00080000:2.0:1784935414.442168:0:6525:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:2.0:1784935414.442229:0:6525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x857e02f4e0b16458 00000004:00100000:2.0:1784935414.442243:0:6525:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784935414.442272:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8d4443393000 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1784935414.442615:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1784935414.442670:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1784935414.442697:0:9516:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784935414.442712:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935414.442722:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784935414.442762:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784935414.442764:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784935414.442766:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935414.442767:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935414.442768:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935414.442770:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935414.442776:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784935414.442778:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784935414.442779:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784935414.442781:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935414.442782:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784935414.442785:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1784935414.442787:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784935414.442789:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784935414.442790:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935414.442791:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935414.442792:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935414.442793:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935414.442795:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784935414.442795:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784935414.442796:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784935414.442797:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935414.442798:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784935414.442830:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784935414.442909:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292003968:0@lo:253: 00000100:00100000:1.0:1784935414.443083:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935414.443112:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f9d480 going to sleep for 11 seconds 00000100:00100000:3.0:1784935414.443552:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292003968 00000100:00100000:3.0:1784935414.443558:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292003968 00000100:00100000:3.0:1784935414.443593:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784935414.443601:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9516:x1871640292003968:12345-0@lo:253: 20000000:01000000:3.0:1784935414.443624:0:6520:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784935414.443637:0:6520:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784935414.446374:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871640292003840:12345-0@lo:38: Request processed in 4218us (4792us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935414.446389:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784935414.446708:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4581d96d80 x1871640292003840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935414.446721:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784935414.446730:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1784935414.446738:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784935414.446744:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784935414.446747:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44430bf000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784935414.446754:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1871640292003840:0@lo:38: 20000000:01000000:3.0:1784935414.449251:0:6520:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784935414.449270:0:6520:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1784935414.449334:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784935414.449340:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784935414.449362:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.449383:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1634e expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.449404:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b1639b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16394 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.449411:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.449446:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b1639b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16394 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.449458:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b1639b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16394 expref: 17 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.449470:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d96d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640292004096:0@lo:104: 00000100:00100000:2.0:1784935414.449954:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784935414.450003:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b1634e expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.450013:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b1634e expref: 17 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.450023:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570542300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640292004224:0@lo:104: 00000100:00100000:0.0:1784935414.450165:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292004096 00000100:00100000:0.0:1784935414.450172:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292004096 00000100:00100000:3.0:1784935414.450194:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9516:x1871640292003968:12345-0@lo:253: Request processed in 6591us (7108us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935414.450205:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784935414.450240:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784935414.450252:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570540000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6541:x1871640292004096:12345-0@lo:104: 00010000:00010000:0.0:1784935414.450265:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935414.450338:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9516:1871640292003968:0@lo:253: 00000100:00100000:2.0:1784935414.450346:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1784935414.450364:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000100:00100000:2.0:1784935414.450365:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70240 going to sleep for 11 seconds 00000020:01000004:1.0:1784935414.450369:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784935414.450372:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784935414.450373:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935414.450375:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935414.450376:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935414.450378:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935414.450380:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784935414.450381:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784935414.450383:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784935414.450385:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935414.450386:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784935414.450401:0:9516:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1784935414.450597:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935414.450604:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570540000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6541:x1871640292004096:12345-0@lo:104: Request processed in 356us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.450611:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784935414.450623:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292004224 00000100:00100000:0.0:1784935414.450627:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292004224 00000100:00100000:0.0:1784935414.450653:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935414.450667:0:6509:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6541:x1871640292004224:12345-0@lo:104: 00010000:00010000:0.0:1784935414.450675:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.450715:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784935414.450721:0:6509:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:6541:x1871640292004224:12345-0@lo:104: Request processed in 55us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.450727:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1784935414.450753:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784935414.450759:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.450768:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540031800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935414.450772:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.450780:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935414.450787:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935414.450803:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935414.450843:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.450850:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935414.450868:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.450875:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16394 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1639b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.450886:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935414.450889:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.450894:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030400 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935414.450897:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.450904:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935414.450910:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935414.450915:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935414.450949:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.450955:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935414.450975:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.450982:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4540030400/0x857e02f4e0b1634e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16355 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.450996:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935414.450997:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935414.450999:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935414.451006:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935414.451022:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292004352:0@lo:103: 00000100:00100000:0.0:1784935414.451062:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.451098:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292004480:0@lo:103: 00000100:00100000:0.0:1784935414.451119:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935414.451148:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292004352 00000100:00100000:0.0:1784935414.451152:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292004352 00010000:00010000:0.0:1784935414.451168:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b1639b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16394 expref: 17 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.451197:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292004480 00000100:00100000:0.0:1784935414.451200:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292004480 00010000:00010000:0.0:1784935414.451212:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16355 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1634e expref: 18 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935414.451238:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784935414.451244:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:3650:x1871640292004352:12345-0@lo:103: 00010000:00010000:0.0:1784935414.451255:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935414.451260:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b1639b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16394 expref: 18 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451279:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b1639b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16394 expref: 18 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451305:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935414.451332:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:3650:x1871640292004352:12345-0@lo:103: Request processed in 88us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.451338:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784935414.451351:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935414.451356:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:3651:x1871640292004480:12345-0@lo:103: 00010000:00010000:0.0:1784935414.451372:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935414.451377:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16355 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1634e expref: 17 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451385:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b1634e expref: 17 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451397:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451404:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784935414.451416:0:6510:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004182949s 00010000:00010000:0.0:1784935414.451421:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451427:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451434:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451445:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451450:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301c00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935414.451454:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451461:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451469:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935414.451478:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935414.451504:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:3651:x1871640292004480:12345-0@lo:103: Request processed in 147us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935414.451510:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935414.451541:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292004480:0@lo:103: 00000100:00100000:0.0:1784935414.451559:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292004352:0@lo:103: 00010000:00010000:2.0:1784935414.452383:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b1639b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16394 expref: 16 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.452397:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d96d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640292004096:0@lo:104: 00010000:00010000:2.0:1784935414.452406:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b1634e expref: 15 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935414.452422:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570542300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1871640292004224:0@lo:104: 00010000:00010000:2.0:1784935414.452439:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.452447:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.452453:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935414.452459:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b1645f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1784935414.460262:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1784935414.460512:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1784935414.460689:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1784935414.460844:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1784935414.461325:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1784935414.461562:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1784935414.463172:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1784935414.471121:0:9516:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1784935414.471139:0:9516:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1784935414.471173:0:9516:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784935414.471277:0:9516:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.128@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784935414.471296:0:9516:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1784935414.471314:0:9516:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1784935414.472242:0:9516:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784935414.474568:0:9516:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1784935414.894439:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784935415.325284:0:9589:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784935415.325526:0:9589:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784935415.918161:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935416.237559:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292004608:0@lo:13: 00000100:00100000:1.0:1784935416.237628:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935416.237724:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292004608 00000100:00100000:2.0:1784935416.237732:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292004608 00000100:00100000:2.0:1784935416.238016:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784935416.238029:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292004608:12345-0@lo:13: 00002000:00000024:2.0:1784935416.238058:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935416.238168:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292004608:12345-0@lo:13: Request processed in 142us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935416.238252:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784935416.238302:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292004736:0@lo:13: 00000100:00100000:0.0:1784935416.238331:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935416.238374:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292004736 00000100:00100000:0.0:1784935416.238379:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292004736 00000100:00100000:0.0:1784935416.238406:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784935416.238413:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292004736:12345-0@lo:13: 00002000:00000024:0.0:1784935416.238423:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935416.238453:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292004736:12345-0@lo:13: Request processed in 41us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935416.238460:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784935416.238493:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421df800 x1871640292004736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935416.238511:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292004736:0@lo:13: 00000100:00080000:1.0:1784935416.238588:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784935416.238609:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570542300 x1871640292004608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935416.238622:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292004608:0@lo:13: 00000100:00100000:0.0:1784935416.749256:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292004864:0@lo:41: 00000100:00100000:0.0:1784935416.749327:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935416.750283:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292004864 00000100:00100000:3.0:1784935416.750292:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292004864 00000100:00100000:3.0:1784935416.750344:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784935416.750355:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292004864:12345-0@lo:41: 00000004:00000024:3.0:1784935416.750388:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1784935416.750456:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292004864:12345-0@lo:41: Request processed in 103us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935416.750464:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784935416.750506:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292004864:0@lo:41: 00010000:00010000:0.0:1784935416.942141:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935417.966497:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935418.992113:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935419.309178:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784935419.309412:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292004992:0@lo:41: 00000100:00100000:3.0:1784935419.309486:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935419.309604:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292004992 00000100:00100000:1.0:1784935419.309613:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292004992 00000100:00100000:1.0:1784935419.309876:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784935419.309887:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292004992:12345-0@lo:41: 00000004:00000024:1.0:1784935419.309923:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1784935419.310002:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292004992:12345-0@lo:41: Request processed in 116us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935419.310009:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784935419.310140:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292004992:0@lo:41: 00000100:00100000:1.0:1784935419.823974:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292005120:0@lo:400: 00000100:00100000:2.0:1784935419.824099:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292005248:0@lo:400: 00000100:00100000:0.0:1784935419.825094:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292005504:0@lo:400: 00000100:00100000:1.0:1784935419.829279:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935419.829344:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292005632:0@lo:400: 00000100:00100000:1.0:1784935419.829386:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935419.829408:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292006144:0@lo:400: 00000100:00100000:1.0:1784935419.829430:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935419.829469:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292005632 00000100:00100000:1.0:1784935419.829477:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292005632 00000100:00100000:1.0:1784935419.829533:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784935419.829541:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292005632:12345-0@lo:400: 00000100:00100000:1.0:1784935419.829591:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292005632:12345-0@lo:400: Request processed in 51us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935419.829599:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784935419.829619:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292006144 00000100:00100000:1.0:1784935419.829622:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292006144 00000100:00100000:1.0:1784935419.829652:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784935419.829658:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292006144:12345-0@lo:400: 00000100:00100000:1.0:1784935419.829688:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292006144:12345-0@lo:400: Request processed in 30us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935419.829694:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1784935419.829711:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935419.829754:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292005632:0@lo:400: 00010000:00080000:1.0:1784935419.829768:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb5500 x1871640292006144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935419.829778:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292006144:0@lo:400: 00000100:00100000:0.0:1784935419.830540:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935419.830578:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292005504 00000100:00100000:0.0:1784935419.830583:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292005504 00000100:00100000:0.0:1784935419.830622:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784935419.830630:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292005504:12345-0@lo:400: 00000100:00100000:0.0:1784935419.830675:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292005504:12345-0@lo:400: Request processed in 45us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935419.830683:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784935419.830964:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935419.831004:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292005760:0@lo:400: 00000100:00100000:2.0:1784935419.831044:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935419.831060:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292006272:0@lo:400: 00000100:00100000:2.0:1784935419.831078:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935419.831101:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784935419.831108:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292005376:0@lo:400: 00000100:00100000:2.0:1784935419.831129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935419.831338:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292005888:0@lo:400: 00000100:00100000:2.0:1784935419.831361:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935419.831376:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292006400:0@lo:400: 00000100:00100000:2.0:1784935419.831398:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784935419.831540:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421dd180 x1871640292005504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935419.831553:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292005504:0@lo:400: 00000100:00100000:0.0:1784935419.831565:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292005248 00000100:00100000:0.0:1784935419.831569:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292005248 00000100:00100000:0.0:1784935419.831590:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292005760 00000100:00100000:0.0:1784935419.831592:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292005760 00000100:00100000:0.0:1784935419.831614:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292006272 00000100:00100000:0.0:1784935419.831617:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292006272 00000100:00100000:0.0:1784935419.831628:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292005888 00000100:00100000:0.0:1784935419.831630:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292005888 00000100:00100000:0.0:1784935419.831643:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292006400 00000100:00100000:0.0:1784935419.831645:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292006400 00000100:00100000:0.0:1784935419.831659:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784935419.831665:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292005248:12345-0@lo:400: 00000100:00100000:2.0:1784935419.831779:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784935419.831788:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292005760:12345-0@lo:400: 00000100:00100000:2.0:1784935419.831822:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292005760:12345-0@lo:400: Request processed in 36us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935419.831828:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784935419.831908:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784935419.831916:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292006272:12345-0@lo:400: 00000100:00100000:2.0:1784935419.831968:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292006272:12345-0@lo:400: Request processed in 52us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935419.831973:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784935419.831986:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784935419.832124:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292005376 00000100:00100000:1.0:1784935419.832129:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292005376 00000100:00100000:2.0:1784935419.832224:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292005888:12345-0@lo:400: 00000100:00100000:2.0:1784935419.832259:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292005888:12345-0@lo:400: Request processed in 267us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935419.832266:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784935419.832286:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784935419.832293:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292006400:12345-0@lo:400: 00000100:00100000:2.0:1784935419.832322:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292006400:12345-0@lo:400: Request processed in 30us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935419.832328:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784935419.832458:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292005248:12345-0@lo:400: Request processed in 45us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935419.832466:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1784935419.832490:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935419.832494:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784935419.832520:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb6300 x1871640292005888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935419.832538:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292005888:0@lo:400: 00010000:00080000:0.0:1784935419.832554:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb7100 x1871640292006400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935419.832561:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292006400:0@lo:400: 00010000:00080000:0.0:1784935419.832575:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421de300 x1871640292005248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935419.832584:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292005248:0@lo:400: 00010000:00080000:0.0:1784935419.832599:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421dfb80 x1871640292005760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935419.832608:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292005760:0@lo:400: 00000100:00100000:3.0:1784935419.832614:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292005120 00000100:00100000:3.0:1784935419.832620:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292005120 00010000:00080000:0.0:1784935419.832621:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb5c00 x1871640292006272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935419.832631:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292006272:0@lo:400: 00000100:00100000:3.0:1784935419.832658:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784935419.832667:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:3652:x1871640292005120:12345-0@lo:400: 00000100:00100000:0.0:1784935419.832674:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292006016:0@lo:400: 00000100:00100000:1.0:1784935419.832741:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784935419.832748:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292005376:12345-0@lo:400: 00000100:00100000:2.0:1784935419.833026:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292005120:0@lo:400: 00000100:00100000:0.0:1784935419.836648:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935419.836665:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:3652:x1871640292005120:12345-0@lo:400: Request processed in 3995us (7389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935419.836679:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784935419.836776:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292006016 00000100:00100000:2.0:1784935419.836784:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292006016 00000100:00080000:0.0:1784935419.836838:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935419.836850:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784935419.836858:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292006016:12345-0@lo:400: 00000100:00100000:2.0:1784935419.837284:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292006016:12345-0@lo:400: Request processed in 425us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935419.837292:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784935419.837453:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb6d80 x1871640292006016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935419.837471:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292006016:0@lo:400: 00000100:00100000:1.0:1784935419.838918:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292005376:12345-0@lo:400: Request processed in 6163us (7780us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935419.838953:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784935419.841629:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292005376:0@lo:400: 00000001:02000400:0.0:1784935419.888669:0:9878:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784935420.014826:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784935420.692488:0:9930:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784935420.692795:0:9930:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1784935420.847993:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784935420.848001:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d457b962000 from 39 10000000:01000000:0.0:1784935420.848068:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784935420.848110:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.848122:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.848133:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935420.848157:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292006528:0@lo:101: 00000100:00100000:0.0:1784935420.848226:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.848272:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935420.849391:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292006528 00000100:00100000:3.0:1784935420.849402:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292006528 00000100:00100000:3.0:1784935420.849451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784935420.849460:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640292006528:12345-0@lo:101: 00010000:00010000:3.0:1784935420.849473:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935420.849488:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554020c00/0x857e02f4e0b1646d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16466 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.849512:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554020c00/0x857e02f4e0b1646d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16466 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.849523:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554020c00/0x857e02f4e0b1646d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16466 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.849545:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020c00, rc 0) 00000100:00100000:3.0:1784935420.849605:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292006528:12345-0@lo:101: Request processed in 146us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935420.849611:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784935420.849673:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292006528:0@lo:101: 00010000:00010000:3.0:1784935420.849687:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.849696:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935420.849758:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292006656:0@lo:501: 00000100:00100000:3.0:1784935420.849785:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.849822:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd180 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.849899:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292006656 00000100:00100000:2.0:1784935420.849903:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292006656 00000100:00100000:2.0:1784935420.849944:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784935420.849952:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292006656:12345-0@lo:501: 00000100:00100000:2.0:1784935420.850303:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292006656:12345-0@lo:501: Request processed in 352us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.850310:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784935420.850432:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292006656:0@lo:501: 00000100:00100000:0.0:1784935420.850466:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292006784:0@lo:503: 00000100:00100000:0.0:1784935420.851357:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.851428:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44420623c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.851464:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292006784 00000100:00100000:2.0:1784935420.851647:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292006784 00000100:00100000:2.0:1784935420.851726:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784935420.851735:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292006784:12345-0@lo:503: 00000100:00100000:2.0:1784935420.851869:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292006784:12345-0@lo:503: Request processed in 135us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.851876:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784935420.852115:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292006784:0@lo:503: 00000100:00100000:0.0:1784935420.852401:0:9947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9947:1871640292006912:0@lo:502: 00000100:00100000:0.0:1784935420.852439:0:9947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.852498:0:9947:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062900 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.852533:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292006912 00000100:00100000:2.0:1784935420.852538:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292006912 00000100:00100000:2.0:1784935420.852599:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784935420.852606:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9947:x1871640292006912:12345-0@lo:502: 00000100:00100000:2.0:1784935420.852687:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9947:x1871640292006912:12345-0@lo:502: Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.852694:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784935420.852747:0:9947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9947:1871640292006912:0@lo:502: 00000100:00100000:0.0:1784935420.852785:0:9947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9947:1871640292007040:0@lo:502: 00000100:00100000:0.0:1784935420.852816:0:9947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.852904:0:9947:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062900 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.852990:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292007040 00000100:00100000:2.0:1784935420.852994:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292007040 00000100:00100000:2.0:1784935420.853094:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784935420.853101:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9947:x1871640292007040:12345-0@lo:502: 00000100:00100000:2.0:1784935420.853162:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:9947:x1871640292007040:12345-0@lo:502: Request processed in 61us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.853168:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784935420.853282:0:9947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9947:1871640292007040:0@lo:502: 00000040:00080000:0.0:1784935420.853306:0:9947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1784935420.853445:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1784935420.853468:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784935420.853477:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.853488:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935420.853496:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784935420.853504:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1784935420.853507:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784935420.853530:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.853537:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.853546:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935420.853557:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292007168:0@lo:101: 00000100:00100000:2.0:1784935420.853585:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.853605:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454831ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.853616:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292007168 00000100:00100000:2.0:1784935420.853620:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292007168 00000100:00100000:2.0:1784935420.853641:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784935420.853647:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292007168:12345-0@lo:101: 00010000:00010000:2.0:1784935420.853656:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935420.853667:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1647b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16474 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.853688:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1647b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16474 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.853697:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1647b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16474 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.853705:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300a00, rc 0) 00000100:00100000:2.0:1784935420.853733:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292007168:12345-0@lo:101: Request processed in 86us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.853745:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784935420.853776:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292007168:0@lo:101: 00010000:00010000:2.0:1784935420.853788:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.853796:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935420.854991:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292007296:0@lo:501: 00000100:00100000:2.0:1784935420.855279:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.855312:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454831ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.855350:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292007296 00000100:00100000:2.0:1784935420.855356:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292007296 00000100:00100000:2.0:1784935420.855395:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784935420.855403:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292007296:12345-0@lo:501: 00000100:00100000:2.0:1784935420.855525:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292007296:12345-0@lo:501: Request processed in 123us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.855533:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784935420.855577:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292007296:0@lo:501: 00000100:00100000:2.0:1784935420.855606:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292007424:0@lo:503: 00000100:00100000:2.0:1784935420.855645:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.855657:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454831ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.855668:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292007424 00000100:00100000:2.0:1784935420.855671:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292007424 00000100:00100000:2.0:1784935420.855692:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784935420.855698:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292007424:12345-0@lo:503: 00000100:00100000:2.0:1784935420.855772:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292007424:12345-0@lo:503: Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.855778:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784935420.855814:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292007424:0@lo:503: 00000100:00100000:2.0:1784935420.857455:0:9948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9948:1871640292007552:0@lo:502: 00000100:00100000:2.0:1784935420.857515:0:9948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.857547:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292007552 00000100:00100000:2.0:1784935420.857552:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292007552 00000100:00100000:2.0:1784935420.857586:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784935420.857592:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9948:x1871640292007552:12345-0@lo:502: 00000100:00100000:2.0:1784935420.857689:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9948:x1871640292007552:12345-0@lo:502: Request processed in 96us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.857697:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784935420.857740:0:9948:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454831e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.857756:0:9948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9948:1871640292007552:0@lo:502: 00000020:01000000:2.0:1784935420.857775:0:9948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935420.857784:0:9948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935420.857786:0:9948:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784935420.857792:0:9948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784935420.857794:0:9948:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784935420.857808:0:9948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9948:1871640292007680:0@lo:502: 00000100:00100000:2.0:1784935420.858527:0:9948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.858599:0:9948:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454831e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935420.858637:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292007680 00000100:00100000:0.0:1784935420.858643:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292007680 00000100:00100000:0.0:1784935420.858709:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784935420.858717:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9948:x1871640292007680:12345-0@lo:502: 00000100:00100000:0.0:1784935420.858814:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:9948:x1871640292007680:12345-0@lo:502: Request processed in 97us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935420.858821:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784935420.858889:0:9948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9948:1871640292007680:0@lo:502: 00000020:01000000:2.0:1784935420.858910:0:9948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935420.858916:0:9948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935420.858923:0:9948:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784935420.858948:0:9948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1784935420.859009:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1784935420.859032:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784935420.859042:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.859053:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935420.859063:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784935420.859066:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4570c47800 from 39 10000000:01000000:2.0:1784935420.859069:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784935420.859095:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.859104:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.859113:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935420.859128:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292007808:0@lo:101: 00000100:00100000:2.0:1784935420.859159:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.859196:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454831e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.859209:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292007808 00000100:00100000:2.0:1784935420.859213:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292007808 00000100:00100000:2.0:1784935420.859239:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784935420.859246:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292007808:12345-0@lo:101: 00010000:00010000:2.0:1784935420.859256:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935420.859273:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d300e00/0x857e02f4e0b16489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16482 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.859293:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d300e00/0x857e02f4e0b16489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16482 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.859302:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d300e00/0x857e02f4e0b16489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16482 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.859310:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300e00, rc 0) 00000100:00100000:2.0:1784935420.859338:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292007808:12345-0@lo:101: Request processed in 92us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.859344:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784935420.859376:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292007808:0@lo:101: 00010000:00010000:2.0:1784935420.859388:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.859397:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935420.859439:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292007936:0@lo:501: 00000100:00100000:2.0:1784935420.859462:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.859474:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454831e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.859485:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292007936 00000100:00100000:2.0:1784935420.859488:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292007936 00000100:00100000:2.0:1784935420.859508:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784935420.859513:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292007936:12345-0@lo:501: 00000100:00100000:2.0:1784935420.859608:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292007936:12345-0@lo:501: Request processed in 95us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.859623:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784935420.859654:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292007936:0@lo:501: 00000100:00100000:2.0:1784935420.859678:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008064:0@lo:503: 00000100:00100000:2.0:1784935420.859711:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.859724:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454831e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.859734:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292008064 00000100:00100000:2.0:1784935420.859737:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292008064 00000100:00100000:2.0:1784935420.859757:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784935420.859762:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292008064:12345-0@lo:503: 00000100:00100000:2.0:1784935420.859829:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292008064:12345-0@lo:503: Request processed in 65us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.859836:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784935420.859874:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008064:0@lo:503: 00000100:00100000:0.0:1784935420.864887:0:9949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9949:1871640292008192:0@lo:502: 00000100:00100000:0.0:1784935420.864998:0:9949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.865027:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292008192 00000100:00100000:3.0:1784935420.865033:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292008192 00000100:00100000:0.0:1784935420.865034:0:9949:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062180 going to sleep for 11 seconds 00000100:00100000:3.0:1784935420.865086:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784935420.865096:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:9949:x1871640292008192:12345-0@lo:502: 00000100:00100000:3.0:1784935420.865232:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:9949:x1871640292008192:12345-0@lo:502: Request processed in 137us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935420.865239:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784935420.865292:0:9949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9949:1871640292008192:0@lo:502: 00000100:00100000:3.0:1784935420.865338:0:9949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9949:1871640292008320:0@lo:502: 00000100:00100000:3.0:1784935420.865372:0:9949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.865395:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292008320 00000100:00100000:3.0:1784935420.865398:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292008320 00000100:00100000:3.0:1784935420.865420:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784935420.865425:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:9949:x1871640292008320:12345-0@lo:502: 00000100:00100000:3.0:1784935420.865483:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:9949:x1871640292008320:12345-0@lo:502: Request processed in 56us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935420.865489:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784935420.865523:0:9949:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935420.865535:0:9949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9949:1871640292008320:0@lo:502: 00000040:00080000:3.0:1784935420.865557:0:9949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1784935420.865835:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1784935420.865856:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784935420.865866:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.865877:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935420.865885:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784935420.865887:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4570c47800 from 6 10000000:01000000:2.0:1784935420.865890:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784935420.865915:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.865962:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.865972:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935420.865984:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008448:0@lo:101: 00000100:00100000:2.0:1784935420.866016:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.866037:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454831e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.866049:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292008448 00000100:00100000:2.0:1784935420.866053:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292008448 00000100:00100000:2.0:1784935420.866078:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784935420.866083:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292008448:12345-0@lo:101: 00010000:00010000:2.0:1784935420.866092:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935420.866104:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d301000/0x857e02f4e0b16497 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16490 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.866124:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d301000/0x857e02f4e0b16497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16490 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.866132:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d301000/0x857e02f4e0b16497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16490 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.866380:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d301000, rc 0) 00000100:00100000:2.0:1784935420.866418:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640292008448:12345-0@lo:101: Request processed in 334us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.866423:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784935420.866466:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008448:0@lo:101: 00010000:00010000:2.0:1784935420.866487:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.866495:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935420.866534:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008576:0@lo:256: 00000100:00100000:2.0:1784935420.866569:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.866583:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454831e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.866596:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292008576 00000100:00100000:2.0:1784935420.866599:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292008576 00000100:00100000:2.0:1784935420.866620:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784935420.866775:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640292008576:12345-0@lo:256: 20000000:01000000:2.0:1784935420.866835:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784935420.866851:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784935420.866854:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1784935420.867131:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640292008576:12345-0@lo:256: Request processed in 504us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.867139:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784935420.867265:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008576:0@lo:256: 10000000:01000000:3.0:1784935420.867307:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784935420.867314:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.867323:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935420.867330:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784935420.867333:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1784935420.867335:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784935420.867357:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.867363:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.867372:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935420.867384:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008704:0@lo:101: 00000100:00100000:3.0:1784935420.867412:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.867548:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935420.867983:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292008704 00000100:00100000:0.0:1784935420.867989:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292008704 00000100:00100000:0.0:1784935420.868032:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784935420.868040:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640292008704:12345-0@lo:101: 00010000:00010000:0.0:1784935420.868051:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935420.868064:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b164a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1649e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.868084:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b164a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1649e expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.868093:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b164a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1649e expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.868101:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540031c00, rc 0) 00000100:00100000:0.0:1784935420.868137:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292008704:12345-0@lo:101: Request processed in 98us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935420.868152:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784935420.868255:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008704:0@lo:101: 00010000:00010000:3.0:1784935420.868270:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.868284:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935420.868345:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008832:0@lo:501: 00000100:00100000:3.0:1784935420.868373:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.868406:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.868495:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292008832 00000100:00100000:2.0:1784935420.868499:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292008832 00000100:00100000:2.0:1784935420.868562:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784935420.868569:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292008832:12345-0@lo:501: 00000100:00100000:2.0:1784935420.868693:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292008832:12345-0@lo:501: Request processed in 125us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.868700:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784935420.868864:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008832:0@lo:501: 00000100:00100000:3.0:1784935420.868896:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008960:0@lo:503: 00000100:00100000:3.0:1784935420.868959:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.868975:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935420.869003:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292008960 00000100:00100000:3.0:1784935420.869006:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292008960 00000100:00100000:3.0:1784935420.869026:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784935420.869032:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292008960:12345-0@lo:503: 00000100:00100000:3.0:1784935420.869109:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292008960:12345-0@lo:503: Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935420.869115:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784935420.883618:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292008960:0@lo:503: 00000100:00100000:1.0:1784935420.885403:0:9951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9951:1871640292009088:0@lo:502: 00000100:00100000:1.0:1784935420.885493:0:9951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.885543:0:9951:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45546d2600 going to sleep for 11 seconds 00000100:00100000:0.0:1784935420.887456:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292009088 00000100:00100000:0.0:1784935420.887471:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292009088 00000100:00100000:0.0:1784935420.887533:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784935420.887542:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:9951:x1871640292009088:12345-0@lo:502: 00000100:00100000:0.0:1784935420.887701:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:9951:x1871640292009088:12345-0@lo:502: Request processed in 160us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935420.887708:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784935420.887969:0:9951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9951:1871640292009088:0@lo:502: 00000020:01000000:1.0:1784935420.888003:0:9951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784935420.888010:0:9951:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1784935420.888017:0:9951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935420.888020:0:9951:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784935420.888026:0:9951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784935420.888030:0:9951:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:01000000:1.0:1784935420.888054:0:9951:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1784935420.888383:0:9951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784935420.888402:0:9951:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d444209cd40) 00000020:00000080:1.0:1784935420.888427:0:9951:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1784935420.888435:0:9951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784935420.888551:0:9951:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1784935420.888559:0:9951:0:(osd_handler.c:8933:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784935420.888569:0:9951:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b164b3 00010000:00080000:1.0:1784935420.888604:0:9951:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d44430bb800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.128@tcp at head 00010000:00010000:1.0:1784935420.888849:0:9951:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1784935420.888998:0:9951:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1784935420.889010:0:9951:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1784935420.889336:0:9951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935420.889476:0:9951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935420.889630:0:9951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1784935420.889757:0:9951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1784935420.891732:0:9952:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784935420.891739:0:9952:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1784935420.892776:0:9951:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784935420.892788:0:9951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784935420.892828:0:9951:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784935420.892852:0:9951:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b164ba 00000100:00080000:1.0:1784935420.892862:0:9951:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784935420.892868:0:9951:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d44430bb800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935420.892903:0:9951:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d44410fb100 x1871640292009216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784935420.892986:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292009216:0@lo:8: 00000100:00100000:2.0:1784935420.893063:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.893108:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292009216 00000100:00100000:3.0:1784935420.893116:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292009216 00000100:00100000:3.0:1784935420.893225:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784935420.893233:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1871640292009216:12345-0@lo:8: 00010000:00080000:3.0:1784935420.893259:0:8987:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:3.0:1784935420.893287:0:8987:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b164c1 00002000:00100000:3.0:1784935420.893300:0:8987:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d457b988800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1784935420.893305:0:8987:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1784935420.893308:0:8987:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1784935420.893360:0:8987:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1784935420.893877:0:9951:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1784935420.894020:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292009344:0@lo:400: 00000100:00100000:1.0:1784935420.894064:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.894089:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292009856:0@lo:400: 00000100:00100000:1.0:1784935420.894112:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.894129:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292010368:0@lo:400: 00000100:00100000:1.0:1784935420.894150:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.894331:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784935420.894339:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292009472:0@lo:400: 00000100:00100000:1.0:1784935420.894369:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.894389:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292009984:0@lo:400: 00000100:00100000:1.0:1784935420.894412:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.894432:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292010496:0@lo:400: 00000100:00100000:1.0:1784935420.894463:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.894487:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292009728:0@lo:400: 00000100:00100000:1.0:1784935420.894524:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.894553:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292010240:0@lo:400: 00000100:00100000:1.0:1784935420.894581:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1784935420.894596:0:8987:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:1.0:1784935420.894604:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784935420.894612:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292009600:0@lo:400: 00000100:00080000:3.0:1784935420.894628:0:8987:0:(import.c:65:import_set_state_nolock()) ffff8d457b989800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935420.894640:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.894655:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292010112:0@lo:400: 00000100:00100000:1.0:1784935420.894991:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.895028:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292009344 00000100:00100000:1.0:1784935420.895036:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292009344 00000100:00100000:1.0:1784935420.895070:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292009856 00000100:00100000:1.0:1784935420.895072:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292009856 00000100:00100000:0.0:1784935420.895156:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292009472 00000100:00100000:0.0:1784935420.895161:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292009472 00000100:00100000:0.0:1784935420.895268:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292009728 00000100:00100000:0.0:1784935420.895272:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292009728 00000100:00100000:0.0:1784935420.895288:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784935420.895295:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292009472:12345-0@lo:400: 00000100:00100000:0.0:1784935420.895352:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292009472:12345-0@lo:400: Request processed in 57us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935420.895359:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784935420.895375:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784935420.895381:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292009728:12345-0@lo:400: 00000100:00100000:0.0:1784935420.895413:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292009728:12345-0@lo:400: Request processed in 32us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935420.895419:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784935420.895435:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292010368 00000100:00100000:0.0:1784935420.895439:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292010368 00000100:00100000:0.0:1784935420.895450:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292009984 00000100:00100000:0.0:1784935420.895452:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292009984 00000100:00100000:0.0:1784935420.895460:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292010496 00000100:00100000:0.0:1784935420.895470:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292010496 00000100:00100000:0.0:1784935420.895482:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292009600 00000100:00100000:0.0:1784935420.895484:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292009600 00000100:00100000:0.0:1784935420.895495:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784935420.895500:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292009344:12345-0@lo:400: 00000100:00100000:0.0:1784935420.895531:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292009344:12345-0@lo:400: Request processed in 31us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935420.895536:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784935420.895614:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784935420.895621:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292010368:12345-0@lo:400: 00000100:00100000:0.0:1784935420.895652:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292010368:12345-0@lo:400: Request processed in 31us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935420.895658:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784935420.895669:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784935420.895675:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292009984:12345-0@lo:400: 00000100:00100000:0.0:1784935420.895702:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292009984:12345-0@lo:400: Request processed in 27us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935420.895708:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784935420.895719:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784935420.895725:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292010496:12345-0@lo:400: 00000100:00100000:0.0:1784935420.895750:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292010496:12345-0@lo:400: Request processed in 26us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935420.895756:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784935420.895767:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784935420.895773:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292009600:12345-0@lo:400: 00000100:00100000:0.0:1784935420.895813:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292009600:12345-0@lo:400: Request processed in 39us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935420.895825:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:01000000:0.0:1784935420.895908:0:9951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935420.895916:0:9951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935420.895918:0:9951:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784935420.895922:0:9951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784935420.895945:0:9951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935420.895947:0:9951:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784935420.895951:0:9951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784935420.895953:0:9951:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784935420.895985:0:9951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9951:1871640292010624:0@lo:502: 00000100:00100000:0.0:1784935420.896029:0:9951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.896054:0:9951:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062000 going to sleep for 11 seconds 00000100:00100000:1.0:1784935420.896253:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784935420.896263:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292009856:12345-0@lo:400: 00000100:00100000:1.0:1784935420.896296:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292009856:12345-0@lo:400: Request processed in 36us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.896302:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784935420.896328:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292010240 00000100:00100000:1.0:1784935420.896334:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292010240 00000100:00100000:1.0:1784935420.896358:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292010112 00000100:00100000:1.0:1784935420.896361:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292010112 00000100:00100000:1.0:1784935420.896375:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784935420.896381:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292010240:12345-0@lo:400: 00000100:00100000:1.0:1784935420.896425:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292010240:12345-0@lo:400: Request processed in 43us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.896431:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784935420.896442:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784935420.896448:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292010112:12345-0@lo:400: 00000100:00100000:1.0:1784935420.896475:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292010112:12345-0@lo:400: Request processed in 28us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.896487:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784935420.896529:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44410f8700 x1871640292009600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935420.896543:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292009600:0@lo:400: 00010000:00080000:1.0:1784935420.896554:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421dfb80 x1871640292010112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935420.896562:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292010112:0@lo:400: 00000100:00100000:1.0:1784935420.896572:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292009728:0@lo:400: 00010000:00080000:1.0:1784935420.896581:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421de300 x1871640292010240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935420.896589:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292010240:0@lo:400: 00000100:00100000:1.0:1784935420.896626:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292009472:0@lo:400: 00010000:00080000:1.0:1784935420.896637:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421ddf80 x1871640292009984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935420.896645:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292009984:0@lo:400: 00010000:00080000:1.0:1784935420.896655:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566f37480 x1871640292010496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935420.896662:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292010496:0@lo:400: 00010000:00080000:1.0:1784935420.896671:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44410faa00 x1871640292009344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935420.896678:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292009344:0@lo:400: 00010000:00080000:1.0:1784935420.896701:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421dd180 x1871640292009856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935420.896708:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292009856:0@lo:400: 00010000:00080000:1.0:1784935420.896719:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421dea00 x1871640292010368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935420.896726:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292010368:0@lo:400: 00000100:00100000:3.0:1784935420.899388:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3648:x1871640292009216:12345-0@lo:8: Request processed in 6145us (6315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935420.899403:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935420.902056:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292010624 00000100:00100000:2.0:1784935420.902071:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292010624 00000100:00100000:2.0:1784935420.903406:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784935420.903422:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:9951:x1871640292010624:12345-0@lo:502: 00000100:00100000:2.0:1784935420.903596:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:9951:x1871640292010624:12345-0@lo:502: Request processed in 178us (7565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.903605:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784935420.903866:0:9951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9951:1871640292010624:0@lo:502: 00000020:01000000:3.0:1784935420.903903:0:9951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935420.903911:0:9951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935420.903982:0:9951:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784935420.903988:0:9951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1784935420.904065:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1784935420.904092:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784935420.904103:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.904121:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935420.904131:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784935420.904134:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4570329000 from 39 10000000:01000000:3.0:1784935420.904137:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784935420.904845:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1784935420.904851:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44410fb100 x1871640292009216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784935430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935420.904867:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00010000:00010000:3.0:1784935420.904872:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784935420.904876:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00010000:00010000:3.0:1784935420.904884:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784935420.904887:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784935420.904895:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784935420.904899:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44430bb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784935420.904909:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292010752:0@lo:101: 00000100:00100000:3.0:1784935420.904982:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1784935420.905006:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784935420.905016:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292009216:0@lo:8: 00000100:00100000:3.0:1784935420.905021:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bdc00 going to sleep for 11 seconds 00000004:00080000:3.0:1784935420.905132:0:9952:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1784935420.905214:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292010752 00000100:00100000:1.0:1784935420.905222:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292010752 00000100:00100000:1.0:1784935420.905262:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784935420.905271:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292010752:12345-0@lo:101: 00010000:00010000:1.0:1784935420.905284:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935420.905298:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b164cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b164c8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935420.905323:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b164cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b164c8 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935420.905333:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b164cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b164c8 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935420.905342:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d454166ae00, rc 0) 00000100:00100000:1.0:1784935420.905385:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292010752:12345-0@lo:101: Request processed in 114us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.905392:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784935420.906859:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292010752:0@lo:101: 00010000:00010000:3.0:1784935420.906880:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.906891:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935420.906989:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292010880:0@lo:501: 00000100:00100000:3.0:1784935420.907039:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.907062:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bdc00 going to sleep for 11 seconds 00000004:00080000:3.0:1784935420.907127:0:9952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 240157198620ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784935420.907135:0:9952:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1784935420.908332:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292010880 00000100:00100000:2.0:1784935420.908342:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292010880 00000100:00100000:2.0:1784935420.908394:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784935420.908404:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292010880:12345-0@lo:501: 00000100:00100000:2.0:1784935420.908542:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292010880:12345-0@lo:501: Request processed in 139us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.908549:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784935420.908593:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292010880:0@lo:501: 00000100:00100000:2.0:1784935420.908636:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574336680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292011008:0@lo:503: 00000100:00100000:2.0:1784935420.908694:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.908718:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e3a4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.908729:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292011008 00000100:00100000:2.0:1784935420.908732:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292011008 00000100:00100000:2.0:1784935420.908750:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784935420.908755:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292011008:12345-0@lo:503: 00000100:00100000:2.0:1784935420.908829:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292011008:12345-0@lo:503: Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.908836:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784935420.908875:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574336680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292011008:0@lo:503: 00000100:00100000:0.0:1784935420.909490:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9953:1871640292011136:0@lo:700: 00000100:00100000:0.0:1784935420.909535:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.909557:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44420626c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.909608:0:8448:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292011136 00000100:00100000:2.0:1784935420.909613:0:8448:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292011136 00000100:00100000:2.0:1784935420.909668:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935420.909677:0:8448:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9953:x1871640292011136:12345-0@lo:700: 00000100:00100000:2.0:1784935420.909711:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574336680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8448:1871640292011264:0@lo:700: 00000100:00100000:2.0:1784935420.909742:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.909766:0:8448:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935420.909811:0:6532:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292011264 00000100:00100000:3.0:1784935420.909816:0:6532:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292011264 00000100:00100000:3.0:1784935420.909860:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784935420.909868:0:6532:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8448:x1871640292011264:12345-0@lo:700: 00000100:00080000:0.0:1784935420.910024:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935420.910085:0:9956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9956:1871640292011392:0@lo:502: 00000100:00100000:3.0:1784935420.910127:0:9956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.910183:0:9956:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.910259:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292011392 00000100:00100000:2.0:1784935420.910263:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292011392 00000100:00100000:2.0:1784935420.910302:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784935420.910310:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:9956:x1871640292011392:12345-0@lo:502: 00000100:00100000:2.0:1784935420.910408:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:9956:x1871640292011392:12345-0@lo:502: Request processed in 98us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.910416:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784935420.910538:0:9956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9956:1871640292011392:0@lo:502: 00000100:00100000:0.0:1784935420.910591:0:9956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9956:1871640292011520:0@lo:502: 00000100:00100000:0.0:1784935420.910625:0:9956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.910683:0:9956:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062300 going to sleep for 11 seconds 00000004:00080000:3.0:1784935420.910732:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1784935420.916212:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292011520 00000100:00100000:2.0:1784935420.916225:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292011520 00000100:00100000:2.0:1784935420.916275:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784935420.916293:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:9956:x1871640292011520:12345-0@lo:502: 00000100:00100000:2.0:1784935420.916450:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:9956:x1871640292011520:12345-0@lo:502: Request processed in 159us (5824us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.916459:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784935420.916521:0:9956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9956:1871640292011520:0@lo:502: 00000040:00080000:0.0:1784935420.916558:0:9956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1784935420.917081:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1784935420.917116:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784935420.917127:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.917138:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935420.917147:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784935420.917149:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4570329000 from 6 10000000:01000000:2.0:1784935420.917152:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784935420.917290:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.917299:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935420.917308:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935420.917327:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292011648:0@lo:101: 00000100:00100000:2.0:1784935420.917366:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.917402:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935420.917458:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292011648 00000100:00100000:1.0:1784935420.917465:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292011648 00000100:00100000:1.0:1784935420.917543:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1784935420.917560:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292011648:12345-0@lo:101: 00010000:00010000:1.0:1784935420.917573:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935420.917584:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d454166b000/0x857e02f4e0b164dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b164d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935420.917606:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d454166b000/0x857e02f4e0b164dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b164d6 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935420.917615:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d454166b000/0x857e02f4e0b164dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b164d6 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935420.917624:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d454166b000, rc 0) 00000100:00100000:1.0:1784935420.917662:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292011648:12345-0@lo:101: Request processed in 104us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.917668:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784935420.920373:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292011648:0@lo:101: 00010000:00010000:0.0:1784935420.920401:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.920415:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935420.920495:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292011776:0@lo:256: 00000100:00100000:0.0:1784935420.920555:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.920600:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062300 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.920607:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292011776 00000100:00100000:2.0:1784935420.920615:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292011776 00000100:00100000:2.0:1784935420.920668:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784935420.920682:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292011776:12345-0@lo:256: 20000000:01000000:2.0:1784935420.920701:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784935420.920715:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784935420.920718:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1784935420.920889:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292011776:12345-0@lo:256: Request processed in 206us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.920896:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 40000000:02000000:3.0:1784935420.922556:0:6532:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1784935420.927354:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292011776:0@lo:256: 10000000:01000000:1.0:1784935420.927638:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784935420.927649:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935420.927660:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935420.927670:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784935420.927673:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1784935420.927676:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784935420.927722:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935420.927744:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935420.927753:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935420.927772:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570595500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292011904:0@lo:101: 00000100:00100000:1.0:1784935420.927839:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.927973:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292011904 00000100:00100000:0.0:1784935420.927981:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292011904 00000100:00100000:0.0:1784935420.928029:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784935420.928038:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292011904:12345-0@lo:101: 00010000:00010000:0.0:1784935420.928050:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935420.928061:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4540031200/0x857e02f4e0b164eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b164e4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.928083:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4540031200/0x857e02f4e0b164eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b164e4 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.928093:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4540031200/0x857e02f4e0b164eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b164e4 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.928102:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540031200, rc 0) 00000100:00100000:1.0:1784935420.928381:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45546d2780 going to sleep for 11 seconds 00000100:00100000:1.0:1784935420.934055:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292011904:12345-0@lo:101: Request processed in 6007us (6205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.934069:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784935420.934209:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570595500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292011904:0@lo:101: 00010000:00010000:0.0:1784935420.934234:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.934245:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935420.934323:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292012032:0@lo:501: 00000100:00100000:0.0:1784935420.934358:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.934415:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062300 going to sleep for 11 seconds 00000100:00100000:1.0:1784935420.934524:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292012032 00000100:00100000:1.0:1784935420.934531:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292012032 00000100:00100000:1.0:1784935420.934576:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784935420.934584:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292012032:12345-0@lo:501: 00000100:00100000:1.0:1784935420.934707:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292012032:12345-0@lo:501: Request processed in 124us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.934713:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784935420.934744:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292012032:0@lo:501: 00000100:00100000:1.0:1784935420.934772:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292012160:0@lo:503: 00000100:00100000:1.0:1784935420.934809:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.934822:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f0c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935420.934833:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292012160 00000100:00100000:1.0:1784935420.934836:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292012160 00000100:00100000:1.0:1784935420.934856:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784935420.934869:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292012160:12345-0@lo:503: 00000100:00100000:1.0:1784935420.934965:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292012160:12345-0@lo:503: Request processed in 95us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.934972:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784935420.935010:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292012160:0@lo:503: 00000100:00100000:3.0:1784935420.935527:0:6532:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8448:x1871640292011264:12345-0@lo:700: Request processed in 25657us (25782us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935420.935538:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784935420.935659:0:8448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574336680 x1871640292011264/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784935436 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935420.935670:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574336680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8448:1871640292011264:0@lo:700: 40000000:02000000:1.0:1784935420.935678:0:8448:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:2.0:1784935420.945573:0:9957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574336a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9957:1871640292012288:0@lo:502: 00000100:00100000:2.0:1784935420.945673:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.945719:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292012288 00000100:00100000:2.0:1784935420.945721:0:9957:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f1300 going to sleep for 11 seconds 00000100:00100000:3.0:1784935420.945727:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292012288 00000100:00100000:3.0:1784935420.945781:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1784935420.945790:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:9957:x1871640292012288:12345-0@lo:502: 00000100:00100000:3.0:1784935420.946046:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:9957:x1871640292012288:12345-0@lo:502: Request processed in 256us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935420.946053:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784935420.946100:0:9957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574336a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9957:1871640292012288:0@lo:502: 00000020:01000000:2.0:1784935420.946128:0:9957:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784935420.946134:0:9957:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784935420.946141:0:9957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935420.946143:0:9957:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784935420.946157:0:9957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784935420.946160:0:9957:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:01000000:2.0:1784935420.946189:0:9957:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784935420.946192:0:9957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784935420.946205:0:9957:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d457e888000) 00000020:00000080:2.0:1784935420.946226:0:9957:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1784935420.946231:0:9957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784935420.946301:0:9957:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784935420.946306:0:9957:0:(osd_handler.c:8933:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784935420.946314:0:9957:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b164f9 00010000:00080000:2.0:1784935420.946340:0:9957:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4443393800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.128@tcp at head 00010000:00010000:2.0:1784935420.946556:0:9957:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1784935420.946662:0:9957:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1784935420.946677:0:9957:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784935420.946827:0:9957:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784935420.946959:0:9957:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784935420.947082:0:9957:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1784935420.947165:0:9957:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1784935420.948554:0:9958:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784935420.948561:0:9958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784935420.949244:0:9957:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784935420.949254:0:9957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784935420.949289:0:9957:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784935420.949315:0:9957:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b16500 00000100:00080000:3.0:1784935420.949325:0:9957:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784935420.949330:0:9957:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d4443393800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935420.949358:0:9957:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d44419cb800 x1871640292012416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784935420.949385:0:9957:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1784935420.949417:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292012416:0@lo:8: 00000020:01000000:3.0:1784935420.949436:0:9957:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935420.949441:0:9957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935420.949443:0:9957:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784935420.949446:0:9957:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935420.949451:0:9957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935420.949458:0:9957:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784935420.949463:0:9957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784935420.949465:0:9957:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784935420.949488:0:9957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9957:1871640292012544:0@lo:502: 00000100:00100000:2.0:1784935420.949488:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.949538:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.949557:0:9957:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784935420.949623:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292012416 00000100:00100000:1.0:1784935420.949629:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292012416 00000100:00100000:1.0:1784935420.949668:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784935420.949675:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1871640292012416:12345-0@lo:8: 00010000:00080000:1.0:1784935420.949700:0:8440:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:1.0:1784935420.949728:0:8440:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b16507 00002000:00100000:1.0:1784935420.949740:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d44428f1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784935420.949745:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1784935420.949748:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784935420.949810:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784935420.949830:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8d44428f3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935420.949885:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1871640292012416:12345-0@lo:8: Request processed in 208us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.949893:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784935420.949963:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292012544 00010000:00080000:0.0:1784935420.949966:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44419cb800 x1871640292012416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784935430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935420.949970:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292012544 00000100:00100000:0.0:1784935420.949980:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784935420.949988:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784935420.949995:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784935420.949999:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784935420.950002:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4443393800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784935420.950007:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784935420.950015:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:9957:x1871640292012544:12345-0@lo:502: 00000004:00080000:0.0:1784935420.950017:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784935420.950024:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292012416:0@lo:8: 00000100:00100000:2.0:1784935420.950124:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:9957:x1871640292012544:12345-0@lo:502: Request processed in 109us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.950132:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000004:00080000:2.0:1784935420.950163:0:9958:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1784935420.950197:0:9957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:9957:1871640292012544:0@lo:502: 00000004:00080000:2.0:1784935420.950214:0:9958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 240200285051ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784935420.950222:0:9958:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:3.0:1784935420.950225:0:9957:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935420.950231:0:9957:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935420.950233:0:9957:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784935420.950237:0:9957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000001:00100000:0.0:1784935420.950266:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1784935420.950286:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1784935420.950310:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784935420.950320:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.950330:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935420.950340:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784935420.950342:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d4572a3b380 from 1 10000000:01000000:3.0:1784935420.950346:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784935420.950370:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.950378:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.950387:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935420.950410:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292012672:0@lo:101: 00000100:00100000:3.0:1784935420.950441:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.950472:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935420.950550:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292012672 00000100:00100000:0.0:1784935420.950555:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292012672 00000100:00100000:1.0:1784935420.950574:0:8448:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9953:x1871640292011136:12345-0@lo:700: Request processed in 40897us (41038us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.950592:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784935420.950596:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1784935420.950606:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292012672:12345-0@lo:101: 00010000:00010000:0.0:1784935420.950616:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935420.950629:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1650e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.950651:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1650e expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.950661:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1650e expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935420.950671:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540030e00, rc 0) 00010000:00080000:2.0:1784935420.950696:0:9953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb7100 x1871640292011136/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784935436 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935420.950707:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9953:1871640292011136:0@lo:700: 00000100:00100000:0.0:1784935420.951102:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292012672:12345-0@lo:101: Request processed in 497us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935420.951119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784935420.951820:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292012672:0@lo:101: 00010000:00010000:3.0:1784935420.951849:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.951860:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935420.951948:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292012800:0@lo:501: 00000100:00100000:3.0:1784935420.951985:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.952019:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.952328:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292012800 00000100:00100000:2.0:1784935420.952335:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292012800 00000100:00100000:2.0:1784935420.952378:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784935420.952385:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292012800:12345-0@lo:501: 00000100:00100000:2.0:1784935420.952513:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292012800:12345-0@lo:501: Request processed in 128us (527us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784935420.952553:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1784935420.952581:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292012800:0@lo:501: 00000004:00080000:0.0:1784935420.952612:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:3.0:1784935420.952614:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784935420.952630:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935420.952640:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784935420.958985:0:9953:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1784935420.959022:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419cb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9953:1871640292013056:0@lo:7: 00000100:00100000:3.0:1784935420.959104:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.959221:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292012928:0@lo:13: 00000100:00100000:1.0:1784935420.959258:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.959273:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292013056 00000100:00100000:3.0:1784935420.959290:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292013056 00000100:00100000:3.0:1784935420.959338:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784935420.959347:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9953:x1871640292013056:12345-0@lo:7: 00000100:00100000:2.0:1784935420.959388:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292012928 00000100:00100000:2.0:1784935420.959393:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292012928 00000100:00100000:2.0:1784935420.959471:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784935420.959480:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1871640292012928:12345-0@lo:13: 00002000:00000024:2.0:1784935420.959498:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1784935420.959546:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1871640292012928:12345-0@lo:13: Request processed in 67us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.959553:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1784935420.961864:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44419c9f80 x1871640292012928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935420.961889:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292012928:0@lo:13: 00000100:00100000:0.0:1784935420.962048:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292013184:0@lo:13: 00000100:00100000:0.0:1784935420.962103:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1784935420.962154:0:9959:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1784935420.962185:0:9959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9959:1871640292013312:0@lo:7: 00000100:00100000:1.0:1784935420.962216:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935420.962238:0:9959:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.962319:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292013184 00000100:00100000:2.0:1784935420.962326:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292013184 00000100:00100000:2.0:1784935420.962373:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784935420.962382:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1871640292013184:12345-0@lo:13: 00002000:00000024:2.0:1784935420.962403:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1784935420.963047:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1871640292013184:12345-0@lo:13: Request processed in 664us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935420.963055:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1784935420.963364:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570595880 x1871640292013184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935420.963383:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292013184:0@lo:13: 00000100:00080000:0.0:1784935420.963408:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935420.964282:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292013312 00000100:00100000:0.0:1784935420.964292:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292013312 00000100:00100000:0.0:1784935420.964341:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784935420.964350:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9959:x1871640292013312:12345-0@lo:7: 00000100:00100000:2.0:1784935420.964453:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bdb40 going to sleep for 11 seconds 00002000:00080000:3.0:1784935420.967307:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1784935420.967316:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1784935420.967409:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9953:x1871640292013056:12345-0@lo:7: Request processed in 8059us (8300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935420.967420:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1784935420.967463:0:9953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44419cb800 x1871640292013056/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784935436 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935420.967484:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419cb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9953:1871640292013056:0@lo:7: 00000004:00080000:2.0:1784935420.967500:0:9953:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784935420.967645:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574335f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9953:1871640292013440:0@lo:5: 00000100:00100000:2.0:1784935420.967689:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.967720:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f1900 going to sleep for 11 seconds 00000100:00100000:1.0:1784935420.968013:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292013440 00000100:00100000:1.0:1784935420.968021:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292013440 00000100:00100000:1.0:1784935420.968060:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784935420.968068:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9953:x1871640292013440:12345-0@lo:5: 00002000:00080000:1.0:1784935420.968091:0:8987:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1784935420.968134:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9953:x1871640292013440:12345-0@lo:5: Request processed in 67us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.968141:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1784935420.968307:0:9953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574335f80 x1871640292013440/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784935436 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935420.968317:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574335f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9953:1871640292013440:0@lo:5: 00000004:00080000:3.0:1784935420.968325:0:9953:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1784935420.968350:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9953:1871640292013568:0@lo:5: 00000100:00100000:3.0:1784935420.968376:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935420.968397:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292013568 00000100:00100000:3.0:1784935420.968400:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292013568 00000100:00100000:3.0:1784935420.968424:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784935420.968432:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9953:x1871640292013568:12345-0@lo:5: 00002000:00080000:3.0:1784935420.968462:0:8987:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1784935420.969895:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935420.971819:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9953:x1871640292013568:12345-0@lo:5: Request processed in 3384us (3438us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784935420.971832:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1784935420.971982:0:9953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44419c8700 x1871640292013568/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784935436 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935420.971999:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9953:1871640292013568:0@lo:5: 00000004:00080000:2.0:1784935420.972015:0:9953:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1784935420.972062:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574335880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9953:1871640292013696:0@lo:900: 00000100:00100000:2.0:1784935420.972098:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935420.973022:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f1180 going to sleep for 11 seconds 00002000:00080000:3.0:1784935420.973732:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1784935420.973739:0:8441:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1784935420.973805:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9959:x1871640292013312:12345-0@lo:7: Request processed in 9452us (11584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935420.973815:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1784935420.974004:0:9959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570594700 x1871640292013312/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784935436 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935420.974020:0:9959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9959:1871640292013312:0@lo:7: 00000004:00080000:0.0:1784935420.974033:0:9959:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1784935420.974067:0:9959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9959:1871640292013824:0@lo:5: 00000100:00100000:0.0:1784935420.974113:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.974156:0:9959:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062180 going to sleep for 11 seconds 00000100:00100000:2.0:1784935420.974305:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292013824 00000100:00100000:2.0:1784935420.974312:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292013824 00000100:00100000:2.0:1784935420.974363:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784935420.974373:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9959:x1871640292013824:12345-0@lo:5: 00002000:00080000:2.0:1784935420.974399:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1784935420.974404:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1784935420.975298:0:6537:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292013696 00000100:00100000:1.0:1784935420.975306:0:6537:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292013696 00000100:00100000:1.0:1784935420.975416:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784935420.975425:0:6537:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9953:x1871640292013696:12345-0@lo:900: 00000100:00100000:1.0:1784935420.975498:0:6537:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9953:x1871640292013696:12345-0@lo:900: Request processed in 74us (3399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935420.975505:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784935420.975579:0:9953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574335880 x1871640292013696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784935436 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935420.975599:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574335880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9953:1871640292013696:0@lo:900: 00000001:00080000:3.0:1784935420.979203:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1784935420.979223:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1784935420.979231:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784935420.979483:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9959:x1871640292013824:12345-0@lo:5: Request processed in 5108us (5366us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784935420.979495:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1784935420.979567:0:9959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb6300 x1871640292013824/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784935436 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935420.979577:0:9959:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1784935420.979583:0:9959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9959:1871640292013824:0@lo:5: 00000004:00080000:0.0:1784935420.979597:0:9959:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1784935420.979650:0:9959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44431f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9959:1871640292013952:0@lo:700: 00000100:00100000:0.0:1784935420.979682:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935420.979741:0:9959:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062180 going to sleep for 11 seconds 00000100:00100000:3.0:1784935420.979786:0:8447:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292013952 00000100:00100000:3.0:1784935420.979792:0:8447:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292013952 00000100:00100000:3.0:1784935420.979879:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784935420.979888:0:8447:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9959:x1871640292013952:12345-0@lo:700: 00000100:00100000:3.0:1784935420.991613:0:8447:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9959:x1871640292013952:12345-0@lo:700: Request processed in 11717us (11920us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935420.991627:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784935420.993082:0:9959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44431f3100 x1871640292013952/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784935436 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935420.993099:0:9959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44431f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9959:1871640292013952:0@lo:700: 00000004:02000040:0.0:1784935420.997439:0:9959:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1784935421.000691:0:9959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44431f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9959:1871640292014080:0@lo:5: 00000100:00100000:0.0:1784935421.000757:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935421.000805:0:9959:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062180 going to sleep for 11 seconds 00000100:00100000:1.0:1784935421.000973:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292014080 00000100:00100000:1.0:1784935421.000981:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292014080 00000100:00100000:1.0:1784935421.001036:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784935421.001045:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9959:x1871640292014080:12345-0@lo:5: 00002000:00080000:1.0:1784935421.006819:0:8987:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1784935421.006839:0:8987:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1784935421.014465:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9959:x1871640292014080:12345-0@lo:5: Request processed in 13414us (13701us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1784935421.014478:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1784935421.014973:0:9959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44431f3100 x1871640292014080/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784935436 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935421.014991:0:9959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44431f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9959:1871640292014080:0@lo:5: 00000004:00080000:2.0:1784935421.015004:0:9959:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1784935421.038298:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935421.359612:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292014208:0@lo:13: 00000100:00100000:1.0:1784935421.359677:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935421.359748:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292014208 00000100:00100000:1.0:1784935421.359756:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292014208 00000100:00100000:1.0:1784935421.359809:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784935421.359818:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292014208:12345-0@lo:13: 00002000:00000024:1.0:1784935421.359856:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935421.359898:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292014208:12345-0@lo:13: Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935421.359906:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1784935421.359970:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574335880 x1871640292014208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935421.359988:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292014208:0@lo:13: 00000100:00080000:1.0:1784935421.360025:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935421.365768:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935421.365792:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292014336:0@lo:13: 00000100:00100000:3.0:1784935421.365866:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935421.365917:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292014336 00000100:00100000:3.0:1784935421.365923:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292014336 00000100:00100000:3.0:1784935421.366092:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784935421.366101:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292014336:12345-0@lo:13: 00002000:00000024:3.0:1784935421.366122:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935421.366168:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292014336:12345-0@lo:13: Request processed in 68us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935421.366188:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1784935421.366212:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784935421.366239:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44419c8380 x1871640292014336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935421.366254:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292014336:0@lo:13: 00000001:00080000:2.0:1784935421.393760:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1784935421.871665:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935421.871692:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292014464:0@lo:41: 00000100:00100000:0.0:1784935421.871761:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935421.872510:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292014464 00000100:00100000:2.0:1784935421.872522:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292014464 00000100:00100000:2.0:1784935421.872579:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784935421.872589:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292014464:12345-0@lo:41: 00000004:00000024:2.0:1784935421.872637:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784935421.872700:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292014464:12345-0@lo:41: Request processed in 112us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935421.872707:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784935421.873201:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292014464:0@lo:41: 00010000:00010000:2.0:1784935422.062590:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935423.085181:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784935423.263508:0:10042:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784935423.263780:0:10042:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1784935423.962330:0:10090:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784935423.962339:0:10090:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1784935424.110270:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935424.342903:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935424.343345:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273092736 00000100:00100000:0.0:1784935424.343356:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273092736 00000100:00100000:3.0:1784935424.343440:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 177 00000100:00100000:3.0:1784935424.343449:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2390:x1871640273092736:12345-192.168.203.28@tcp:250: 00010000:00080000:3.0:1784935424.343490:0:6520:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 065c8aa1-ae1a-4743-85eb-344bf4a888c9@192.168.203.28@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:3.0:1784935424.343515:0:6520:0:(genops.c:1406:class_connect()) connect: client 065c8aa1-ae1a-4743-85eb-344bf4a888c9, cookie 0x857e02f4e0b1651c 00000100:00080000:3.0:1784935424.343638:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8d4443394800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784935424.343709:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+5:2390:x1871640273092736:12345-192.168.203.28@tcp:250: Request processed in 259us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935424.343717:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 177 00000100:00100000:1.0:1784935424.349315:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935424.349533:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273092864 00000100:00100000:2.0:1784935424.349543:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273092864 00000100:00100000:2.0:1784935424.349598:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 178 00000100:00100000:2.0:1784935424.349607:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+5:6148:x1871640273092864:12345-192.168.203.28@tcp:101: 00010000:00010000:2.0:1784935424.349624:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935424.349640:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d300400/0x857e02f4e0b16523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a7bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935424.349667:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d300400/0x857e02f4e0b16523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7bf expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935424.349679:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d300400/0x857e02f4e0b16523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7bf expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935424.349688:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300400, rc 0) 00000100:00100000:2.0:1784935424.349746:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+6:6148:x1871640273092864:12345-192.168.203.28@tcp:101: Request processed in 140us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935424.349753:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 178 00000100:00100000:0.0:1784935424.353125:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935424.353197:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273092992 00000100:00100000:3.0:1784935424.353206:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273092992 00000100:00100000:3.0:1784935424.353256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 179 00000100:00100000:3.0:1784935424.353265:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+6:6148:x1871640273092992:12345-192.168.203.28@tcp:501: 00000100:00100000:3.0:1784935424.353375:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+6:6148:x1871640273092992:12345-192.168.203.28@tcp:501: Request processed in 110us (266us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784935424.353383:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 179 00000100:00100000:1.0:1784935424.356105:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935424.358687:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273093120 00000100:00100000:0.0:1784935424.358703:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273093120 00000100:00100000:0.0:1784935424.358831:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 180 00000100:00100000:0.0:1784935424.358841:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+6:6148:x1871640273093120:12345-192.168.203.28@tcp:101: 00010000:00010000:0.0:1784935424.358860:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935424.358877:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4540030600/0x857e02f4e0b1652a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a7c6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935424.358923:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4540030600/0x857e02f4e0b1652a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7c6 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935424.358963:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4540030600/0x857e02f4e0b1652a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7c6 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935424.358973:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540030600, rc 0) 00000100:00100000:0.0:1784935424.359045:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+7:6148:x1871640273093120:12345-192.168.203.28@tcp:101: Request processed in 205us (2948us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935424.359053:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 180 00000100:00100000:1.0:1784935424.361264:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935424.361367:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273093248 00000100:00100000:2.0:1784935424.361384:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273093248 00000100:00100000:2.0:1784935424.361475:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 181 00000100:00100000:2.0:1784935424.361485:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+7:6148:x1871640273093248:12345-192.168.203.28@tcp:501: 00000100:00100000:2.0:1784935424.361666:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+8:6148:x1871640273093248:12345-192.168.203.28@tcp:501: Request processed in 183us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935424.361674:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 181 00000100:00100000:1.0:1784935424.366775:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935424.369219:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273093376 00000100:00100000:0.0:1784935424.369234:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273093376 00000100:00100000:1.0:1784935424.372028:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 182 00000100:00100000:1.0:1784935424.372041:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+8:6148:x1871640273093376:12345-192.168.203.28@tcp:503: 00000100:00100000:1.0:1784935424.372227:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+8:6148:x1871640273093376:12345-192.168.203.28@tcp:503: Request processed in 187us (5461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935424.372236:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 182 00000100:00100000:0.0:1784935424.377619:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935424.379951:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273093504 00000100:00100000:1.0:1784935424.379966:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273093504 00000100:00100000:1.0:1784935424.380033:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 183 00000100:00100000:1.0:1784935424.380043:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+8:6166:x1871640273093504:12345-192.168.203.28@tcp:502: 00000100:00100000:1.0:1784935424.380271:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+8:6166:x1871640273093504:12345-192.168.203.28@tcp:502: Request processed in 229us (2661us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935424.380280:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 183 00000100:00100000:2.0:1784935424.421162:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935424.421227:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273093632 00000100:00100000:0.0:1784935424.421238:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273093632 00000100:00100000:0.0:1784935424.421294:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 184 00000100:00100000:0.0:1784935424.421304:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+8:6166:x1871640273093632:12345-192.168.203.28@tcp:502: 00000100:00100000:0.0:1784935424.421481:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+8:6166:x1871640273093632:12345-192.168.203.28@tcp:502: Request processed in 177us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935424.421489:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 184 00000100:00100000:0.0:1784935424.429213:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292014592:0@lo:41: 00000100:00100000:0.0:1784935424.429284:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935424.429527:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292014592 00000100:00100000:1.0:1784935424.429535:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292014592 00000100:00100000:1.0:1784935424.429585:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784935424.429594:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292014592:12345-0@lo:41: 00000004:00000024:1.0:1784935424.429627:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1784935424.429680:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292014592:12345-0@lo:41: Request processed in 87us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935424.429687:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784935424.429771:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292014592:0@lo:41: 00000100:00100000:0.0:1784935424.432887:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935424.433001:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273093760 00000100:00100000:3.0:1784935424.433010:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273093760 00000100:00100000:3.0:1784935424.433066:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 185 00000100:00100000:3.0:1784935424.433077:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+8:6148:x1871640273093760:12345-192.168.203.28@tcp:101: 00010000:00010000:3.0:1784935424.433101:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935424.433127:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b16531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a7f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935424.433167:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b16531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7f7 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935424.433178:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b16531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7f7 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935424.433200:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541528a00, rc 0) 00000100:00100000:3.0:1784935424.433259:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6148:x1871640273093760:12345-192.168.203.28@tcp:101: Request processed in 183us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935424.433266:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 185 00000100:00100000:2.0:1784935424.437772:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935424.437895:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273093888 00000100:00100000:1.0:1784935424.437904:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273093888 00000100:00100000:1.0:1784935424.438013:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 186 00000100:00100000:1.0:1784935424.438023:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6148:x1871640273093888:12345-192.168.203.28@tcp:256: 20000000:01000000:1.0:1784935424.438059:0:6518:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784935424.438072:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784935424.438076:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784935424.438089:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784935424.438092:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1784935424.438094:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1784935424.444302:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6148:x1871640273093888:12345-192.168.203.28@tcp:256: Request processed in 6269us (6527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935424.444317:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 186 00000100:00100000:0.0:1784935424.449680:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935424.449748:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273094016 00000100:00100000:2.0:1784935424.449757:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273094016 00000100:00100000:2.0:1784935424.449812:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 187 00000100:00100000:2.0:1784935424.449820:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6148:x1871640273094016:12345-192.168.203.28@tcp:101: 00010000:00010000:2.0:1784935424.449837:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935424.449852:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b16538 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a7fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935424.449878:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b16538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7fe expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935424.449889:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b16538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7fe expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935424.449897:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d301a00, rc 0) 00000100:00100000:2.0:1784935424.449968:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6148:x1871640273094016:12345-192.168.203.28@tcp:101: Request processed in 148us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935424.449974:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 187 00000100:00100000:2.0:1784935424.451918:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935424.453815:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273094144 00000100:00100000:1.0:1784935424.453829:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273094144 00000100:00100000:1.0:1784935424.453905:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 188 00000100:00100000:1.0:1784935424.453915:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6148:x1871640273094144:12345-192.168.203.28@tcp:501: 00000100:00100000:1.0:1784935424.454076:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6148:x1871640273094144:12345-192.168.203.28@tcp:501: Request processed in 161us (2163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935424.454085:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 188 00000100:00100000:0.0:1784935424.462320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935424.462421:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273094272 00000100:00100000:1.0:1784935424.462431:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273094272 00000100:00100000:1.0:1784935424.462492:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 189 00000100:00100000:1.0:1784935424.462502:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6148:x1871640273094272:12345-192.168.203.28@tcp:503: 00000100:00100000:1.0:1784935424.462650:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6148:x1871640273094272:12345-192.168.203.28@tcp:503: Request processed in 149us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935424.462658:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 189 00000100:00100000:0.0:1784935424.467857:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935424.468271:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273094400 00000100:00100000:2.0:1784935424.468288:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273094400 00000100:00100000:2.0:1784935424.468342:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 190 00000100:00100000:2.0:1784935424.468352:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6171:x1871640273094400:12345-192.168.203.28@tcp:502: 00000100:00100000:2.0:1784935424.468588:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6171:x1871640273094400:12345-192.168.203.28@tcp:502: Request processed in 236us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935424.468597:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 190 00000100:00100000:2.0:1784935424.470308:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935424.470439:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273094528 00000100:00100000:3.0:1784935424.470449:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273094528 00000100:00100000:3.0:1784935424.470566:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 191 00000100:00100000:3.0:1784935424.470576:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6171:x1871640273094528:12345-192.168.203.28@tcp:502: 00000100:00100000:3.0:1784935424.470711:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6171:x1871640273094528:12345-192.168.203.28@tcp:502: Request processed in 136us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935424.470719:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 191 00000100:00100000:0.0:1784935424.473758:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935424.473870:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273094656 00000100:00100000:2.0:1784935424.473879:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273094656 00000100:00100000:0.0:1784935424.474177:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935424.474574:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273094912 00000100:00100000:2.0:1784935424.474580:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273094912 00000100:00100000:2.0:1784935424.474612:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:2.0:1784935424.474621:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1871640273094656:12345-192.168.203.28@tcp:38: 00010000:00080000:2.0:1784935424.474652:0:6525:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:2.0:1784935424.474704:0:6525:0:(genops.c:1406:class_connect()) connect: client 380c344d-145d-4a03-bcd4-797f2a6954a7, cookie 0x857e02f4e0b1653f 00000004:00100000:2.0:1784935424.474730:0:6525:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784935424.474920:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8d457b98d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784935424.475293:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2390:x1871640273094656:12345-192.168.203.28@tcp:38: Request processed in 671us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935424.475302:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:2.0:1784935424.475322:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 8 00000100:00100000:2.0:1784935424.475328:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1871640273094912:12345-192.168.203.28@tcp:38: 00010000:00080000:2.0:1784935424.475344:0:6525:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:2.0:1784935424.475375:0:6525:0:(genops.c:1406:class_connect()) connect: client 380c344d-145d-4a03-bcd4-797f2a6954a7, cookie 0x857e02f4e0b16546 00000004:00100000:2.0:1784935424.475388:0:6525:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784935424.475615:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8d457e89a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784935424.475649:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2390:x1871640273094912:12345-192.168.203.28@tcp:38: Request processed in 320us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935424.475656:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 8 00010000:00010000:2.0:1784935425.134901:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935425.485897:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935425.486029:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273095168 00000100:00100000:2.0:1784935425.486038:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273095168 00000100:00100000:3.0:1784935425.486298:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935425.486348:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935425.486468:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273095040 00000100:00100000:0.0:1784935425.486472:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273095040 00000100:00100000:2.0:1784935425.486542:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273094784 00000100:00100000:2.0:1784935425.486546:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273094784 00000100:00100000:2.0:1784935425.486563:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 9 00000100:00100000:2.0:1784935425.486572:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+7:6148:x1871640273095168:12345-192.168.203.28@tcp:41: 00000004:00000024:2.0:1784935425.486617:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1784935425.486680:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+7:6148:x1871640273095168:12345-192.168.203.28@tcp:41: Request processed in 108us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935425.486687:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 9 00000100:00100000:2.0:1784935425.486703:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00100000:2.0:1784935425.486709:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:0:x1871640273094784:12345-192.168.203.28@tcp:41: 00000004:00000024:2.0:1784935425.486719:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1784935425.486738:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:0:x1871640273094784:12345-192.168.203.28@tcp:41: Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935425.486743:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00080000:1.0:1784935425.488328:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784935425.488337:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935425.488497:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00100000:0.0:1784935425.488509:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:0:x1871640273095040:12345-192.168.203.28@tcp:41: 00000004:00000024:0.0:1784935425.488540:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935425.488610:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:0:x1871640273095040:12345-192.168.203.28@tcp:41: Request processed in 103us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935425.488617:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00100000:3.0:1784935425.490466:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935425.490541:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273095296 00000100:00100000:2.0:1784935425.490549:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273095296 00000100:00100000:2.0:1784935425.490598:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 12 00000100:00100000:2.0:1784935425.490606:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6148:x1871640273095296:12345-192.168.203.28@tcp:40: 00000100:00100000:2.0:1784935425.490684:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6148:x1871640273095296:12345-192.168.203.28@tcp:40: Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935425.490691:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 12 00000100:00100000:3.0:1784935425.494271:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935425.494317:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935425.494345:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935425.494379:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935425.494501:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273095424 00000100:00100000:2.0:1784935425.494511:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273095424 00000100:00100000:2.0:1784935425.494542:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273095552 00000100:00100000:2.0:1784935425.494545:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273095552 00000100:00100000:2.0:1784935425.494562:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00100000:2.0:1784935425.494570:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1871640273095424:12345-192.168.203.28@tcp:8: 00010000:00080000:2.0:1784935425.494600:0:8440:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1784935425.494632:0:8440:0:(genops.c:1406:class_connect()) connect: client 380c344d-145d-4a03-bcd4-797f2a6954a7, cookie 0x857e02f4e0b1654d 00002000:00100000:2.0:1784935425.494643:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 380c344d-145d-4a03-bcd4-797f2a6954a7/ffff8d457e89b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784935425.494660:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784935425.494818:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784935425.494843:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8d457e89b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935425.494955:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:1.0:1784935425.494962:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1871640273095552:12345-192.168.203.28@tcp:8: 00010000:00080000:1.0:1784935425.494989:0:8439:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1784935425.495004:0:8439:0:(genops.c:1406:class_connect()) connect: client 380c344d-145d-4a03-bcd4-797f2a6954a7, cookie 0x857e02f4e0b16554 00002000:00100000:1.0:1784935425.495009:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 380c344d-145d-4a03-bcd4-797f2a6954a7/ffff8d44428f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784935425.495019:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784935425.495123:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784935425.495138:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8d44428f0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784935425.495320:0:6536:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273095680 00000100:00100000:0.0:1784935425.495326:0:6536:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273095680 00000100:00100000:0.0:1784935425.495359:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 4 00000100:00100000:0.0:1784935425.495366:0:6536:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6148:x1871640273095680:12345-192.168.203.28@tcp:900: 00000100:00100000:2.0:1784935425.495902:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2390:x1871640273095424:12345-192.168.203.28@tcp:8: Request processed in 1329us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935425.495910:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00100000:2.0:1784935425.496007:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273095808 00000100:00100000:2.0:1784935425.496011:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273095808 00000100:00100000:2.0:1784935425.496041:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 192 00000100:00100000:2.0:1784935425.496048:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2391:x1871640273095808:12345-192.168.203.28@tcp:400: 00000100:00100000:1.0:1784935425.496260:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2390:x1871640273095552:12345-192.168.203.28@tcp:8: Request processed in 1295us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935425.496267:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:0.0:1784935425.497284:0:6536:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6148:x1871640273095680:12345-192.168.203.28@tcp:900: Request processed in 1912us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935425.497295:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 4 00000100:00100000:2.0:1784935425.497405:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2391:x1871640273095808:12345-192.168.203.28@tcp:400: Request processed in 1356us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935425.497412:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 192 00000100:00100000:0.0:1784935425.499492:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935425.499729:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273095936 00000100:00100000:1.0:1784935425.499738:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273095936 00000100:00100000:1.0:1784935425.500306:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 0 00000100:00100000:1.0:1784935425.500318:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6148:x1871640273095936:12345-192.168.203.28@tcp:33: 00000004:00080000:1.0:1784935425.518432:0:6528:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 18028us 00000004:00200000:1.0:1784935425.529480:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784935425.529591:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6148:x1871640273095936:12345-192.168.203.28@tcp:33: Request processed in 29271us (30101us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935425.529601:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 0 00000100:00100000:3.0:1784935425.711363:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935425.711476:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273096064 00000100:00100000:0.0:1784935425.711486:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273096064 00000100:00100000:0.0:1784935425.711780:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 13 00000100:00100000:0.0:1784935425.711792:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6189:x1871640273096064:12345-192.168.203.28@tcp:101: 00010000:00010000:0.0:1784935425.711813:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935425.711975:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b1655b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a82f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935425.712039:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b16562 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935425.712067:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b16562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935425.712082:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b16562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935425.712127:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784935425.712131:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935425.712154:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b16562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935425.712178:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b1655b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a82f expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935425.712198:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b16562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a82f expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935425.712207:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d44432ed500) 00010000:00010000:0.0:1784935425.712210:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784935425.712212:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540030c00, rc 0) 00000100:00100000:0.0:1784935425.712333:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:6189:x1871640273096064:12345-192.168.203.28@tcp:101: Request processed in 543us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935425.712340:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 13 00000100:00100000:0.0:1784935425.965955:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292014720:0@lo:13: 00000100:00100000:0.0:1784935425.966040:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935425.967702:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784935425.967724:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292014848:0@lo:13: 00000100:00100000:0.0:1784935425.967797:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935425.967979:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292014720 00000100:00100000:1.0:1784935425.967988:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292014720 00000100:00100000:1.0:1784935425.968035:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292014848 00000100:00100000:1.0:1784935425.968038:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292014848 00000100:00100000:1.0:1784935425.968054:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784935425.968061:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292014720:12345-0@lo:13: 00002000:00000024:1.0:1784935425.968083:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935425.968152:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292014720:12345-0@lo:13: Request processed in 78us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935425.968160:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784935425.968177:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784935425.968184:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292014848:12345-0@lo:13: 00002000:00000024:1.0:1784935425.968195:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935425.968218:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292014848:12345-0@lo:13: Request processed in 35us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935425.968224:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1784935425.968256:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570595f80 x1871640292014848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935425.968266:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1784935425.968284:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292014848:0@lo:13: 00010000:00080000:1.0:1784935425.968296:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570597100 x1871640292014720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935425.968303:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784935425.968320:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292014720:0@lo:13: 00000100:00080000:0.0:1784935425.968493:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935425.968525:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292015104:0@lo:400: 00000100:00100000:3.0:1784935425.968550:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292015232:0@lo:400: 00000100:00100000:0.0:1784935425.968562:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935425.968588:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292015616:0@lo:400: 00000100:00100000:3.0:1784935425.968592:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935425.968677:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292015360:0@lo:400: 00000100:00100000:1.0:1784935425.970249:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292014976:0@lo:400: 00000100:00100000:3.0:1784935425.972925:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292015744:0@lo:400: 00000100:00100000:3.0:1784935425.973070:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935425.973121:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292016256:0@lo:400: 00000100:00100000:3.0:1784935425.973161:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935425.973220:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292015232 00000100:00100000:3.0:1784935425.973228:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292015232 00000100:00100000:3.0:1784935425.973291:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784935425.973300:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292015232:12345-0@lo:400: 00000100:00100000:3.0:1784935425.973357:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292015232:12345-0@lo:400: Request processed in 58us (4767us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935425.973364:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784935425.973390:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292015104 00000100:00100000:3.0:1784935425.973395:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292015104 00000100:00100000:3.0:1784935425.973419:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292015744 00000100:00100000:3.0:1784935425.973422:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292015744 00000100:00100000:3.0:1784935425.973443:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292016256 00000100:00100000:3.0:1784935425.973446:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292016256 00000100:00100000:3.0:1784935425.973460:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784935425.973467:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292015104:12345-0@lo:400: 00000100:00100000:3.0:1784935425.973719:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292015104:12345-0@lo:400: Request processed in 34us (4939us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935425.973728:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784935425.973743:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784935425.973749:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292015744:12345-0@lo:400: 00000100:00100000:3.0:1784935425.973787:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292015744:12345-0@lo:400: Request processed in 38us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935425.973793:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784935425.973805:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784935425.973811:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292016256:12345-0@lo:400: 00000100:00100000:3.0:1784935425.973918:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292016256:12345-0@lo:400: Request processed in 107us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935425.973955:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1784935425.973973:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935425.974074:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292015232:0@lo:400: 00010000:00080000:3.0:1784935425.974092:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428aed80 x1871640292015744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935425.974103:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292015744:0@lo:400: 00010000:00080000:3.0:1784935425.974113:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428ac000 x1871640292016256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935425.974120:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292016256:0@lo:400: 00000100:00100000:0.0:1784935425.976558:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935425.976693:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292016128:0@lo:400: 00000100:00100000:3.0:1784935425.976740:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292015616 00000100:00100000:0.0:1784935425.976747:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935425.976749:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292015616 00000100:00100000:0.0:1784935425.977132:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292015104:0@lo:400: 00000100:00100000:2.0:1784935425.977583:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935425.977865:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935425.977898:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292015488:0@lo:400: 00000100:00100000:1.0:1784935425.977943:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935425.978364:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292016000:0@lo:400: 00000100:00100000:1.0:1784935425.978393:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935425.978435:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292016000 00000100:00100000:1.0:1784935425.978441:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292016000 00000100:00100000:1.0:1784935425.982190:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784935425.982205:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292016000:12345-0@lo:400: 00000100:00100000:1.0:1784935425.982299:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292016000:12345-0@lo:400: Request processed in 99us (3905us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935425.982307:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935425.982338:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292015872:0@lo:400: 00010000:00080000:1.0:1784935425.982358:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428aea00 x1871640292016000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935425.982376:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292016000:0@lo:400: 00000100:00100000:2.0:1784935425.982379:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935425.982410:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292015872 00000100:00100000:1.0:1784935425.982416:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292015872 00000100:00080000:2.0:1784935425.982437:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784935425.982443:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935425.982453:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784935425.982460:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292015872:12345-0@lo:400: 00000100:00100000:0.0:1784935425.982494:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292016128 00000100:00100000:3.0:1784935425.982497:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292015360 00000100:00100000:0.0:1784935425.982501:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292016128 00000100:00100000:3.0:1784935425.982505:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292015360 00000100:00100000:1.0:1784935425.982520:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292015872:12345-0@lo:400: Request processed in 58us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935425.982527:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784935425.982551:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292015488 00000100:00100000:1.0:1784935425.982554:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292015488 00000100:00100000:1.0:1784935425.982581:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784935425.982590:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292015488:12345-0@lo:400: 00000100:00100000:3.0:1784935425.982593:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784935425.982608:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292015616:12345-0@lo:400: 00000100:00100000:0.0:1784935425.982615:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784935425.982628:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292015360:12345-0@lo:400: 00000100:00100000:1.0:1784935425.982635:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292015488:12345-0@lo:400: Request processed in 46us (4689us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935425.982643:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784935425.982675:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292015616:12345-0@lo:400: Request processed in 69us (6123us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935425.982683:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292015488:0@lo:400: 00000100:00100000:0.0:1784935425.982685:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292015360:12345-0@lo:400: Request processed in 59us (5101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935425.982686:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784935425.982699:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784935425.982715:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784935425.982716:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292014976 00000100:00100000:1.0:1784935425.982722:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292014976 00000100:00100000:3.0:1784935425.982727:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292016128:12345-0@lo:400: 00000100:00100000:3.0:1784935425.982756:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292016128:12345-0@lo:400: Request processed in 32us (6009us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935425.982761:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784935425.982917:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292015360:0@lo:400: 00010000:00080000:0.0:1784935425.982950:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428ad180 x1871640292015872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935425.982959:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292015872:0@lo:400: 00000100:00100000:3.0:1784935425.983006:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292016128:0@lo:400: 00000100:00100000:3.0:1784935425.983167:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292015616:0@lo:400: 00000100:00080000:3.0:1784935425.983200:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935425.985130:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784935425.985379:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292014976:12345-0@lo:400: 00000100:00100000:1.0:1784935425.985482:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292014976:12345-0@lo:400: Request processed in 344us (7617us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935425.985490:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784935425.985636:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292014976:0@lo:400: 00010000:00010000:2.0:1784935426.157524:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935426.478643:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292016384:0@lo:13: 00000100:00100000:0.0:1784935426.478715:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935426.478849:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292016384 00000100:00100000:3.0:1784935426.478856:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292016384 00000100:00100000:3.0:1784935426.478907:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784935426.478916:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292016384:12345-0@lo:13: 00002000:00000024:3.0:1784935426.478955:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935426.479005:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292016384:12345-0@lo:13: Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935426.479013:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1784935426.479052:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428ae300 x1871640292016384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935426.479070:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292016384:0@lo:13: 00000100:00100000:1.0:1784935426.479905:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292016512:0@lo:13: 00000100:00100000:1.0:1784935426.479977:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935426.480100:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292016512 00000100:00100000:3.0:1784935426.480107:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292016512 00000100:00100000:3.0:1784935426.480168:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784935426.480177:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292016512:12345-0@lo:13: 00002000:00000024:3.0:1784935426.480193:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935426.484029:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292016512:12345-0@lo:13: Request processed in 3843us (4041us total) trans 0 rc 0/0 00010000:00080000:1.0:1784935426.484040:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44429da300 x1871640292016512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935426.484047:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784935426.484071:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292016512:0@lo:13: 00000100:00100000:1.0:1784935426.989900:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935426.989946:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292016640:0@lo:41: 00000100:00100000:1.0:1784935426.990011:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935426.990368:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292016640 00000100:00100000:3.0:1784935426.990376:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292016640 00000100:00100000:3.0:1784935426.990425:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784935426.990433:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292016640:12345-0@lo:41: 00000004:00000024:3.0:1784935426.990466:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784935426.990519:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292016640:12345-0@lo:41: Request processed in 87us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935426.990539:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784935426.990764:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292016640:0@lo:41: 00010000:00010000:2.0:1784935427.181965:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935427.680723:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935427.680814:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273096192 00000100:00100000:3.0:1784935427.680824:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273096192 00000100:00100000:3.0:1784935427.680898:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00100000:3.0:1784935427.680909:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:6241:x1871640273096192:12345-192.168.203.28@tcp:41: 00000004:00000024:3.0:1784935427.680973:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1784935427.681047:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:6241:x1871640273096192:12345-192.168.203.28@tcp:41: Request processed in 141us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935427.681055:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00080000:2.0:1784935427.681421:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935427.683657:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935427.686320:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273096320 00000100:00100000:0.0:1784935427.686334:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273096320 00000100:00100000:0.0:1784935427.686494:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00100000:0.0:1784935427.686508:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6241:x1871640273096320:12345-192.168.203.28@tcp:41: 00000004:00000024:0.0:1784935427.686552:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935427.686636:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6241:x1871640273096320:12345-192.168.203.28@tcp:41: Request processed in 133us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935427.686644:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00080000:2.0:1784935427.688819:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935427.692779:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935427.693035:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273096448 00000100:00100000:2.0:1784935427.693059:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273096448 00000100:00100000:2.0:1784935427.693154:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00100000:2.0:1784935427.693166:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6241:x1871640273096448:12345-192.168.203.28@tcp:13: 00002000:00000024:2.0:1784935427.693197:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935427.693271:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6241:x1871640273096448:12345-192.168.203.28@tcp:13: Request processed in 107us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935427.693278:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00080000:3.0:1784935427.693433:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935427.699509:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935427.699867:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273096576 00000100:00100000:2.0:1784935427.699879:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273096576 00000100:00100000:2.0:1784935427.700037:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00100000:2.0:1784935427.700048:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6241:x1871640273096576:12345-192.168.203.28@tcp:13: 00002000:00000024:2.0:1784935427.700082:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935427.700173:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:380c344d-145d-4a03-bcd4-797f2a6954a7+6:6241:x1871640273096576:12345-192.168.203.28@tcp:13: Request processed in 127us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935427.700180:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00080000:3.0:1784935427.706419:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784935428.205377:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935429.229217:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935429.549184:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292016768:0@lo:41: 00000100:00100000:3.0:1784935429.549256:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935429.549389:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292016768 00000100:00100000:1.0:1784935429.549398:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292016768 00000100:00100000:1.0:1784935429.549450:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784935429.549460:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292016768:12345-0@lo:41: 00000004:00000024:1.0:1784935429.549496:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1784935429.549557:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292016768:12345-0@lo:41: Request processed in 98us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935429.549564:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784935429.550789:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292016768:0@lo:41: 00000001:00100000:0.0:1784935429.551235:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000001:02000400:1.0:1784935430.020420:0:10188:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1784935430.253154:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784935430.578797:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000001:00100000:1.0:1784935430.583569:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000100:00100000:0.0:1784935430.830879:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935430.830953:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935430.830992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935430.831012:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935430.831040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935430.831066:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273096960 00000100:00100000:0.0:1784935430.831076:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273096960 00000100:00100000:2.0:1784935430.831149:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273096704 00000100:00100000:0.0:1784935430.831149:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273096832 00000100:00100000:2.0:1784935430.831153:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273096704 00000100:00100000:0.0:1784935430.831153:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273096832 00000100:00100000:0.0:1784935430.831176:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 45 00000100:00100000:2.0:1784935430.831178:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 194 00000100:00100000:2.0:1784935430.831184:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2394:x1871640273096704:12345-192.168.203.28@tcp:400: 00000100:00100000:0.0:1784935430.831184:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273096960:12345-192.168.203.28@tcp:400: 00000100:00100000:2.0:1784935430.831244:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2394:x1871640273096704:12345-192.168.203.28@tcp:400: Request processed in 59us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935430.831251:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 194 00000100:00100000:1.0:1784935430.831301:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 46 00000100:00080000:3.0:1784935430.831382:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784935430.831387:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935430.831586:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273096832:12345-192.168.203.28@tcp:400: 00000100:00100000:1.0:1784935430.835728:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273096832:12345-192.168.203.28@tcp:400: Request processed in 4135us (4703us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935430.835975:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273097216 00000100:00100000:3.0:1784935430.835984:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273097216 00000100:00100000:3.0:1784935430.836122:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273097088 00000100:00100000:3.0:1784935430.836126:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273097088 00000100:00080000:2.0:1784935430.837020:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784935430.837027:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784935430.837073:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00100000:2.0:1784935430.837087:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273097216:12345-192.168.203.28@tcp:400: 00000100:00100000:2.0:1784935430.837172:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273097216:12345-192.168.203.28@tcp:400: Request processed in 90us (6179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935430.837179:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00100000:2.0:1784935430.837612:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00100000:2.0:1784935430.837620:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273097088:12345-192.168.203.28@tcp:400: 00000100:00100000:2.0:1784935430.837658:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273097088:12345-192.168.203.28@tcp:400: Request processed in 39us (6616us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935430.837665:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00100000:0.0:1784935430.839085:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273096960:12345-192.168.203.28@tcp:400: Request processed in 7892us (8122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935430.839098:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 45 00000100:00100000:1.0:1784935430.839178:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 46 00000100:00100000:3.0:1784935431.085142:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292017024:0@lo:400: 00000100:00100000:1.0:1784935431.085187:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292017280:0@lo:400: 00000100:00100000:3.0:1784935431.085211:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935431.085260:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292017536:0@lo:400: 00000100:00100000:3.0:1784935431.085291:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935431.085324:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292018048:0@lo:400: 00000100:00100000:3.0:1784935431.085415:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935431.085446:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292018560:0@lo:13: 00000100:00100000:3.0:1784935431.085496:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935431.085522:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1784935431.085528:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292017152:0@lo:400: 00000100:00100000:3.0:1784935431.085551:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935431.085567:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292017664:0@lo:400: 00000100:00100000:3.0:1784935431.085586:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935431.085600:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292018176:0@lo:400: 00000100:00100000:3.0:1784935431.085619:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935431.085630:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292018688:0@lo:13: 00000100:00100000:3.0:1784935431.085652:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935431.085683:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292017024 00000100:00100000:3.0:1784935431.085691:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292017024 00000100:00100000:3.0:1784935431.085726:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292017536 00000100:00100000:3.0:1784935431.085729:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292017536 00000100:00100000:3.0:1784935431.085754:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292018048 00000100:00100000:3.0:1784935431.085756:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292018048 00000100:00100000:3.0:1784935431.085770:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292017664 00000100:00100000:3.0:1784935431.085772:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292017664 00000100:00100000:3.0:1784935431.085783:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292018176 00000100:00100000:3.0:1784935431.085786:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292018176 00000100:00100000:3.0:1784935431.085802:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784935431.085810:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292017024:12345-0@lo:400: 00000100:00100000:3.0:1784935431.085865:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292017024:12345-0@lo:400: Request processed in 54us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935431.085872:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784935431.085892:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784935431.085898:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292017536:12345-0@lo:400: 00000100:00100000:1.0:1784935431.085910:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784935431.085919:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292018048:12345-0@lo:400: 00000100:00100000:3.0:1784935431.085943:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292017536:12345-0@lo:400: Request processed in 28us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935431.085955:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784935431.085972:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292018048:12345-0@lo:400: Request processed in 55us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935431.085978:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784935431.085984:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292017664:12345-0@lo:400: 00000100:00100000:3.0:1784935431.086017:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292017664:12345-0@lo:400: Request processed in 33us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935431.086024:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784935431.086035:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784935431.086041:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292018176:12345-0@lo:400: 00000100:00100000:3.0:1784935431.086066:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292018176:12345-0@lo:400: Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935431.086071:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784935431.086089:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292018560 00000100:00100000:3.0:1784935431.086093:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292018560 00000100:00100000:3.0:1784935431.086122:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292018688 00000100:00100000:3.0:1784935431.086124:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292018688 00000100:00100000:3.0:1784935431.086137:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784935431.086143:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292018560:12345-0@lo:13: 00002000:00000024:3.0:1784935431.086163:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935431.086193:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292018560:12345-0@lo:13: Request processed in 51us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935431.086199:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784935431.086208:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784935431.086214:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292018688:12345-0@lo:13: 00002000:00000024:3.0:1784935431.086222:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935431.086231:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784935431.086243:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292018688:12345-0@lo:13: Request processed in 30us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935431.086251:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292017152 00000100:00100000:1.0:1784935431.086254:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292017152 00000100:00100000:3.0:1784935431.086258:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1784935431.086273:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784935431.086277:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935431.086277:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1784935431.086279:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935431.086282:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292017152:12345-0@lo:400: 00000100:00100000:3.0:1784935431.086288:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935431.086309:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292017792:0@lo:400: 00000100:00100000:0.0:1784935431.086485:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292016896:0@lo:400: 00000100:00100000:3.0:1784935431.086564:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935431.086585:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292018304:0@lo:400: 00000100:00100000:3.0:1784935431.086604:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935431.086637:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292017792 00000100:00100000:3.0:1784935431.086641:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292017792 00000100:00100000:3.0:1784935431.086669:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292018304 00000100:00100000:3.0:1784935431.086672:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292018304 00000100:00100000:3.0:1784935431.086686:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784935431.086691:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292017792:12345-0@lo:400: 00000100:00100000:3.0:1784935431.086724:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292017792:12345-0@lo:400: Request processed in 32us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935431.086730:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784935431.086741:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784935431.086746:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292018304:12345-0@lo:400: 00000100:00100000:3.0:1784935431.086785:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292018304:12345-0@lo:400: Request processed in 38us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935431.086790:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1784935431.086813:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784935431.086837:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428ac700 x1871640292017792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935431.086850:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292017792:0@lo:400: 00010000:00080000:3.0:1784935431.086869:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428af100 x1871640292018304/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935431.086877:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292018304:0@lo:400: 00000100:00100000:3.0:1784935431.086901:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292017280 00000100:00100000:3.0:1784935431.086904:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292017280 00000100:00100000:3.0:1784935431.086946:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784935431.086953:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292017280:12345-0@lo:400: 00000100:00100000:3.0:1784935431.086989:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292017280:12345-0@lo:400: Request processed in 36us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935431.086994:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784935431.087020:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292017280:0@lo:400: 00000100:00100000:1.0:1784935431.089627:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292017152:12345-0@lo:400: Request processed in 3334us (4064us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935431.089642:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784935431.089728:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292017152:0@lo:400: 00010000:00080000:1.0:1784935431.089746:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428ad880 x1871640292017664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935431.089757:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292017664:0@lo:400: 00010000:00080000:1.0:1784935431.089771:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428ad180 x1871640292018176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935431.089780:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292018176:0@lo:400: 00010000:00080000:1.0:1784935431.089792:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570595880 x1871640292018688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935431.090221:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292018688:0@lo:13: 00010000:00080000:1.0:1784935431.090240:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570594700 x1871640292018560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935431.090251:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292018560:0@lo:13: 00000100:00100000:1.0:1784935431.090263:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292017024:0@lo:400: 00000100:00100000:1.0:1784935431.090275:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292017536:0@lo:400: 00000100:00100000:1.0:1784935431.090286:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292018048:0@lo:400: 00000100:00100000:0.0:1784935431.092624:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935431.092681:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292017408:0@lo:400: 00000100:00100000:1.0:1784935431.092875:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292016896 00000100:00100000:1.0:1784935431.092884:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292016896 00000100:00100000:1.0:1784935431.092948:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1784935431.092954:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935431.092957:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292016896:12345-0@lo:400: 00000100:00100000:0.0:1784935431.092975:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292017920:0@lo:400: 00000100:00100000:0.0:1784935431.093008:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935431.093029:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292018432:0@lo:400: 00000100:00100000:0.0:1784935431.093050:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935431.093084:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292017920 00000100:00100000:0.0:1784935431.093088:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292017920 00000100:00100000:0.0:1784935431.093140:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292018432 00000100:00100000:0.0:1784935431.093143:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292018432 00000100:00100000:0.0:1784935431.093163:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784935431.093169:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292017920:12345-0@lo:400: 00000100:00100000:1.0:1784935431.093172:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292016896:12345-0@lo:400: Request processed in 216us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935431.093179:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1784935431.093198:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292017920:12345-0@lo:400: Request processed in 30us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935431.093204:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784935431.093215:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784935431.093220:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292018432:12345-0@lo:400: 00000100:00100000:0.0:1784935431.093245:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292018432:12345-0@lo:400: Request processed in 25us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935431.093250:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1784935431.093269:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784935431.093281:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292017408 00000100:00100000:0.0:1784935431.093284:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292017408 00000100:00100000:0.0:1784935431.093313:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784935431.093320:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292017408:12345-0@lo:400: 00000100:00100000:0.0:1784935431.093551:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292017408:12345-0@lo:400: Request processed in 230us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935431.093558:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784935431.093600:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292016896:0@lo:400: 00000100:00100000:0.0:1784935431.093613:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292017408:0@lo:400: 00010000:00080000:0.0:1784935431.093634:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428af800 x1871640292017920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935431.093644:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292017920:0@lo:400: 00010000:00080000:0.0:1784935431.093652:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428adf80 x1871640292018432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935431.093659:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292018432:0@lo:400: 00010000:00010000:2.0:1784935431.278453:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935431.599011:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292018816:0@lo:13: 00000100:00100000:3.0:1784935431.600203:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935431.600733:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292018816 00000100:00100000:0.0:1784935431.600742:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292018816 00000100:00100000:0.0:1784935431.600869:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784935431.600881:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292018816:12345-0@lo:13: 00002000:00000024:0.0:1784935431.600911:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935431.600992:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292018816:12345-0@lo:13: Request processed in 114us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935431.600999:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1784935431.601040:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d7b80 x1871640292018816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935431.601059:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292018816:0@lo:13: 00000100:00100000:0.0:1784935431.603399:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292018944:0@lo:13: 00000100:00100000:0.0:1784935431.603465:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935431.603516:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292018944 00000100:00100000:0.0:1784935431.603523:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292018944 00000100:00100000:0.0:1784935431.603552:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784935431.603559:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292018944:12345-0@lo:13: 00002000:00000024:0.0:1784935431.603578:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935431.603619:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292018944:12345-0@lo:13: Request processed in 59us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935431.603872:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1784935431.603912:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443431500 x1871640292018944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935431.603947:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292018944:0@lo:13: 00000001:00100000:0.0:1784935431.608335:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000100:00100000:0.0:1784935432.111712:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935432.114882:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292019072:0@lo:41: 00000100:00100000:0.0:1784935432.114989:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935432.115238:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292019072 00000100:00100000:3.0:1784935432.115247:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292019072 00000100:00100000:3.0:1784935432.115292:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784935432.115301:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292019072:12345-0@lo:41: 00000004:00000024:3.0:1784935432.115340:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784935432.115395:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292019072:12345-0@lo:41: Request processed in 94us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935432.115402:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784935432.115449:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292019072:0@lo:41: 00010000:00010000:2.0:1784935432.302134:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935433.325675:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784935433.549751:0:10335:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1a490020 20000000:00000080:3.0:1784935433.549768:0:10335:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d44429c5c00 uarg=0000000000000000 20000000:01000000:3.0:1784935433.549815:0:10335:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1784935433.549818:0:10335:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1784935433.549820:0:10335:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1784935433.549824:0:10335:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1784935433.549828:0:10335:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1784935433.549880:0:10335:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784935433.549883:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784935433.562416:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1784935433.562765:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1784935433.562798:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1784935433.562815:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1784935433.562827:0:10335:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1784935433.562829:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784935433.563793:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1784935433.564216:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1784935433.564245:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1784935433.564261:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1784935433.564273:0:10335:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784935433.564276:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784935433.568455:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1784935433.568902:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1784935433.569120:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1784935433.569138:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1784935433.569149:0:10335:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784935433.569153:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784935433.569421:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1784935433.569626:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1784935433.569647:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1784935433.569662:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1784935433.569671:0:10335:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1784935433.569673:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784935433.570211:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1784935433.570350:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1784935433.570373:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1784935433.570389:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:1.0:1784935433.570404:0:10335:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784935433.570423:0:10335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570440:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4554020a00/0x857e02f4e0b16404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b163fd expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570445:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4554021200/0x857e02f4e0b1642e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16427 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570449:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4554020c00/0x857e02f4e0b1646d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16466 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570453:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1647b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16474 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570457:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d457d300e00/0x857e02f4e0b16489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16482 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570460:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b164a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1649e expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570471:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b164cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b164c8 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570475:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4540031200/0x857e02f4e0b164eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b164e4 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570480:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1650e expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570485:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d457d300400/0x857e02f4e0b16523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7bf expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570490:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4540030600/0x857e02f4e0b1652a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7c6 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570494:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570534:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4540030600/0x857e02f4e0b1652a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7c6 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570545:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4540030600/0x857e02f4e0b1652a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7c6 expref: 9 pid: 6518 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.570557:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019200:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935433.570643:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d457d300400/0x857e02f4e0b16523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7bf expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570649:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d457d300400/0x857e02f4e0b16523 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7bf expref: 9 pid: 6517 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.570660:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570595880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019328:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935433.570683:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b1650e expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570688:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b1650e expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.570693:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570595500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019456:0@lo:104: 00000100:00100000:1.0:1784935433.570720:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784935433.570752:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4540031200/0x857e02f4e0b164eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b164e4 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.570760:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4540031200/0x857e02f4e0b164eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b164e4 expref: 23 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.570768:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019584:0@lo:104: 00000100:00100000:3.0:1784935433.571060:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292019456 00000100:00100000:3.0:1784935433.571068:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292019456 00000100:00100000:3.0:1784935433.571118:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784935433.571128:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570594e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10335:x1871640292019456:12345-0@lo:104: 00010000:00010000:3.0:1784935433.571143:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.571193:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784935433.571214:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570594e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10335:x1871640292019456:12345-0@lo:104: Request processed in 88us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935433.571221:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1784935433.571242:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935433.571304:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.571312:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020000 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:3.0:1784935433.571316:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.571336:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935433.571343:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935433.571349:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935433.571379:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.571386:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935433.571407:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935433.571410:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292019712:0@lo:103: 00010000:00010000:3.0:1784935433.571414:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b1650e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16515 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.571426:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935433.571427:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935433.571429:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935433.571443:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935433.572221:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784935433.572304:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b164cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b164c8 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.572316:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b164cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b164c8 expref: 23 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.572327:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019840:0@lo:104: 00000100:00100000:1.0:1784935433.572357:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784935433.572430:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b164a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b1649e expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.572453:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b164a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b1649e expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.572462:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019968:0@lo:104: 00000100:00100000:1.0:1784935433.572488:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935433.572558:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292019584 00000100:00100000:0.0:1784935433.572565:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292019584 00000100:00100000:0.0:1784935433.572597:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292019840 00000100:00100000:0.0:1784935433.572599:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292019840 00000100:00100000:0.0:1784935433.572611:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784935433.572617:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:10335:x1871640292019584:12345-0@lo:104: 00010000:00010000:0.0:1784935433.572628:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.572678:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935433.572683:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:10335:x1871640292019584:12345-0@lo:104: Request processed in 67us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935433.572689:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784935433.572703:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784935433.572708:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10335:x1871640292019840:12345-0@lo:104: 00010000:00010000:0.0:1784935433.572715:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.572750:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784935433.572755:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10335:x1871640292019840:12345-0@lo:104: Request processed in 48us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935433.572761:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1784935433.573223:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d457d300e00/0x857e02f4e0b16489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16482 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.573233:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d457d300e00/0x857e02f4e0b16489 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16482 expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.573241:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292020096:0@lo:104: 00010000:00010000:1.0:1784935433.573267:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1647b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16474 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.573274:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1647b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16474 expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.573281:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292020224:0@lo:104: 00010000:00010000:1.0:1784935433.573302:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4554020c00/0x857e02f4e0b1646d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16466 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.573311:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4554020c00/0x857e02f4e0b1646d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16466 expref: 23 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.573318:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292020352:0@lo:104: 00010000:00010000:1.0:1784935433.573342:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4554021200/0x857e02f4e0b1642e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16427 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.573360:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4554021200/0x857e02f4e0b1642e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16427 expref: 23 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.573368:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292020480:0@lo:104: 00010000:00010000:1.0:1784935433.573409:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4554020a00/0x857e02f4e0b16404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b163fd expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.573417:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4554020a00/0x857e02f4e0b16404 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b163fd expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.573425:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292020608:0@lo:104: 00000100:00100000:1.0:1784935433.573446:0:10335:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f039c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935433.573466:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570595500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019456:0@lo:104: 00000100:00100000:1.0:1784935433.573474:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019584:0@lo:104: 00000100:00100000:1.0:1784935433.573481:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019840:0@lo:104: 00000100:00100000:2.0:1784935433.573614:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292019968 00000100:00100000:2.0:1784935433.573620:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292019968 00000100:00100000:1.0:1784935433.573842:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784935433.573863:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935433.573875:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935433.573895:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935433.573907:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935433.573915:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935433.573921:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292020096 00000100:00100000:1.0:1784935433.573924:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292020096 00000100:00100000:1.0:1784935433.573960:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292020224 00000100:00100000:1.0:1784935433.573963:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292020224 00000100:00100000:1.0:1784935433.573972:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292020352 00000100:00100000:1.0:1784935433.573974:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292020352 00000100:00100000:1.0:1784935433.574001:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292020480 00000100:00100000:1.0:1784935433.574009:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292020480 00000100:00100000:1.0:1784935433.574022:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292020608 00000100:00100000:1.0:1784935433.574024:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292020608 00000100:00100000:1.0:1784935433.574037:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784935433.574044:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457428f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+8:10335:x1871640292019968:12345-0@lo:104: 00010000:00010000:1.0:1784935433.574056:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.574113:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784935433.574119:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457428f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+8:10335:x1871640292019968:12345-0@lo:104: Request processed in 77us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935433.574125:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784935433.574159:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784935433.574166:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+7:10335:x1871640292020096:12345-0@lo:104: 00010000:00010000:1.0:1784935433.574173:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.574200:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784935433.574205:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+7:10335:x1871640292020096:12345-0@lo:104: Request processed in 40us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935433.574211:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784935433.574223:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784935433.574229:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:10335:x1871640292020224:12345-0@lo:104: 00010000:00010000:1.0:1784935433.574236:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.574261:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1784935433.574266:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:10335:x1871640292020224:12345-0@lo:104: Request processed in 38us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935433.574278:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784935433.574290:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784935433.574295:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:10335:x1871640292020352:12345-0@lo:104: 00010000:00010000:1.0:1784935433.574302:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.574330:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1784935433.574334:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:10335:x1871640292020352:12345-0@lo:104: Request processed in 40us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935433.574339:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784935433.574348:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784935433.574353:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:10335:x1871640292020480:12345-0@lo:104: 00010000:00010000:1.0:1784935433.574360:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.574382:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1784935433.574386:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:10335:x1871640292020480:12345-0@lo:104: Request processed in 34us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935433.574391:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784935433.574401:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784935433.574406:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10335:x1871640292020608:12345-0@lo:104: 00010000:00010000:1.0:1784935433.574413:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.574438:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1784935433.574443:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10335:x1871640292020608:12345-0@lo:104: Request processed in 38us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935433.574454:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784935433.574682:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019968:0@lo:104: 00000100:00100000:0.0:1784935433.574691:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292020096:0@lo:104: 00000100:00100000:0.0:1784935433.574698:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292020224:0@lo:104: 00000100:00100000:0.0:1784935433.574704:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292020352:0@lo:104: 00000100:00100000:0.0:1784935433.574710:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292020480:0@lo:104: 00000100:00100000:0.0:1784935433.574717:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292020608:0@lo:104: 00000100:00100000:3.0:1784935433.575215:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292019712 00000100:00100000:3.0:1784935433.575221:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292019712 00010000:00010000:3.0:1784935433.575252:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1650e expref: 24 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575282:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1784935433.575289:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575304:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166b400 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935433.575307:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575315:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935433.575322:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935433.575327:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935433.575358:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575365:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935433.575384:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575391:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b164e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b164eb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575403:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1784935433.575406:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575411:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935433.575414:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935433.575415:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784935433.575422:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45729c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3650:x1871640292019712:12345-0@lo:103: 00010000:00010000:2.0:1784935433.575431:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.575432:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935433.575437:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1650e expref: 24 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935433.575438:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935433.575443:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935433.575451:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b1650e expref: 24 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575455:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575460:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935433.575465:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.575466:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540030e00/0x857e02f4e0b16515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b1650e expref: 24 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575472:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b164c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b164cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.575477:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935433.575481:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1784935433.575484:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575488:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020200 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935433.575490:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.575497:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935433.575502:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935433.575568:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45729c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:3650:x1871640292019712:12345-0@lo:103: Request processed in 146us (4123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935433.575575:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784935433.575677:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935433.575698:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935433.575722:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935433.575745:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273097472 00000100:00100000:0.0:1784935433.575749:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273097472 00010000:00010000:0.0:1784935433.575766:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d457d300400/0x857e02f4e0b16523 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7bf expref: 10 pid: 6517 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935433.575794:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273097344 00000100:00100000:0.0:1784935433.575797:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273097344 00010000:00010000:0.0:1784935433.575809:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4540030600/0x857e02f4e0b1652a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7c6 expref: 11 pid: 6518 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935433.575821:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:0.0:1784935433.575827:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:2392:x1871640273097472:12345-192.168.203.28@tcp:103: 00010000:00010000:0.0:1784935433.575843:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935433.575848:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d457d300400/0x857e02f4e0b16523 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7bf expref: 11 pid: 6517 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.575856:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d457d300400/0x857e02f4e0b16523 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7bf expref: 11 pid: 6517 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.575867:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935433.575904:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:2392:x1871640273097472:12345-192.168.203.28@tcp:103: Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935433.575911:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:0.0:1784935433.575943:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 26 00000100:00100000:0.0:1784935433.575951:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2392:x1871640273097344:12345-192.168.203.28@tcp:103: 00010000:00010000:0.0:1784935433.575959:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935433.575963:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4540030600/0x857e02f4e0b1652a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7c6 expref: 10 pid: 6518 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.575973:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4540030600/0x857e02f4e0b1652a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7c6 expref: 10 pid: 6518 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.575995:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935433.576013:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2392:x1871640273097344:12345-192.168.203.28@tcp:103: Request processed in 63us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935433.576019:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 26 00010000:00010000:0.0:1784935433.576057:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540030600/0x857e02f4e0b1652a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7c6 expref: 9 pid: 6518 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935433.576067:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019200:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935433.576087:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d300400/0x857e02f4e0b16523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7bf expref: 8 pid: 6517 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935433.576109:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570595880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1871640292019328:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935433.576155:0:10335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935433.576604:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935433.576732:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.576739:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784935433.576850:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292020992:0@lo:103: 00000100:00100000:1.0:1784935433.576894:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784935433.576973:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.576991:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b1649e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b164a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577004:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784935433.577008:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577013:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301200 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935433.577016:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577023:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935433.577029:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935433.577034:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935433.577054:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577060:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784935433.577119:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292020992 00000100:00100000:0.0:1784935433.577125:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292020992 00010000:00010000:0.0:1784935433.577146:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b164a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1649e expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935433.577162:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784935433.577168:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:3649:x1871640292020992:12345-0@lo:103: 00010000:00010000:0.0:1784935433.577177:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935433.577181:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b164a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1649e expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.577189:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b164a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b1649e expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.577200:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b164a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b1649e expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.577210:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935433.577327:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292021120:0@lo:103: 00000100:00100000:3.0:1784935433.577354:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935433.577384:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292019712:0@lo:103: 00000100:00100000:3.0:1784935433.577408:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292021120 00000100:00100000:3.0:1784935433.577411:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292021120 00010000:00010000:3.0:1784935433.577426:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d457d300e00/0x857e02f4e0b16489 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16482 expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577438:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935433.577440:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1784935433.577445:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16482 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16489 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935433.577446:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:3650:x1871640292021120:12345-0@lo:103: 00010000:00010000:3.0:1784935433.577453:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935433.577455:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784935433.577457:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d457d300e00/0x857e02f4e0b16489 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16482 expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577459:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577465:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300600 already unused, calling callback (ffffffffc12b4c20) 00010000:00010000:3.0:1784935433.577466:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d457d300e00/0x857e02f4e0b16489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16482 expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935433.577468:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577475:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.577476:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d300e00/0x857e02f4e0b16489 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16482 expref: 23 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935433.577481:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935433.577487:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935433.577492:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935433.577499:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577505:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935433.577510:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935433.577518:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:3650:x1871640292021120:12345-0@lo:103: Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935433.577524:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784935433.577548:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273097600 00000100:00100000:3.0:1784935433.577552:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273097600 00000100:00100000:3.0:1784935433.577578:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 196 00000100:00100000:3.0:1784935433.577585:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+8:6162:x1871640273097600:12345-192.168.203.28@tcp:101: 00010000:00010000:2.0:1784935433.577588:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d300600/0x857e02f4e0b16474 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1647b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.577598:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935433.577599:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784935433.577607:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.577610:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16570 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a836 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577612:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540031000 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935433.577616:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577622:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.577626:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935433.577627:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935433.577633:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935433.577636:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16570 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a836 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.577651:0:6520:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.577662:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16570 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a836 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935433.577669:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541528600, rc 0) 00000100:00100000:3.0:1784935433.577704:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6162:x1871640273097600:12345-192.168.203.28@tcp:101: Request processed in 119us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935433.577710:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 196 00010000:00010000:2.0:1784935433.577717:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577723:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935433.577727:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577733:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4540031000/0x857e02f4e0b16466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1646d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577743:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784935433.577746:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577752:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301400 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935433.577754:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577770:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935433.577776:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935433.577780:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935433.577870:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935433.577876:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292021120:0@lo:103: 00010000:00010000:2.0:1784935433.577877:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935433.577882:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935433.577887:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1784935433.577889:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d301400/0x857e02f4e0b16427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1642e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935433.577892:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292021504:0@lo:103: 00010000:00010000:2.0:1784935433.577898:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935433.577901:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577907:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166a800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935433.577909:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935433.577913:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784935433.577917:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935433.577923:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935433.577953:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935433.577967:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.577973:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935433.578068:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.578075:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166a800/0x857e02f4e0b163fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16404 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.578099:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935433.578100:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935433.578102:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935433.578114:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292020736:0@lo:103: 00000100:00100000:2.0:1784935433.578144:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292020864:0@lo:103: 00010000:00010000:2.0:1784935433.578174:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935433.578246:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3649:x1871640292020992:12345-0@lo:103: Request processed in 1077us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935433.578253:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784935433.578297:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292020992:0@lo:103: 00000100:00100000:1.0:1784935433.578308:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935433.578313:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292021632:0@lo:103: 00000100:00100000:1.0:1784935433.578336:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935433.580072:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292021504 00000100:00100000:2.0:1784935433.580086:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292021504 00010000:00010000:2.0:1784935433.580135:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4554021200/0x857e02f4e0b1642e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16427 expref: 21 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935433.580167:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784935433.580177:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3650:x1871640292021504:12345-0@lo:103: 00010000:00010000:2.0:1784935433.580190:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935433.580195:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4554021200/0x857e02f4e0b1642e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16427 expref: 21 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.580221:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4554021200/0x857e02f4e0b1642e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16427 expref: 21 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.580238:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554021200/0x857e02f4e0b1642e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16427 expref: 21 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.580255:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935433.580304:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3650:x1871640292021504:12345-0@lo:103: Request processed in 130us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935433.580311:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784935433.580370:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935433.580391:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292021376:0@lo:103: 00000100:00100000:2.0:1784935433.580427:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935433.580439:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292021248:0@lo:103: 00000100:00100000:2.0:1784935433.580460:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292020864 00000100:00100000:2.0:1784935433.580464:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292020864 00010000:00010000:2.0:1784935433.580479:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b164cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b164c8 expref: 20 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935433.580492:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292020736 00000100:00100000:2.0:1784935433.580494:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292020736 00010000:00010000:2.0:1784935433.580505:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4540031200/0x857e02f4e0b164eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b164e4 expref: 21 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935433.580605:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784935433.580613:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3652:x1871640292020864:12345-0@lo:103: 00010000:00010000:2.0:1784935433.580621:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935433.580625:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b164cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b164c8 expref: 21 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.580712:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b164cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b164c8 expref: 21 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.580723:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b164cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b164c8 expref: 21 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.580734:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935433.580765:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3652:x1871640292020864:12345-0@lo:103: Request processed in 153us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935433.580771:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784935433.580857:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784935433.580868:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45729c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:3651:x1871640292020736:12345-0@lo:103: 00010000:00010000:2.0:1784935433.580876:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935433.580881:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4540031200/0x857e02f4e0b164eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b164e4 expref: 19 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.580889:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4540031200/0x857e02f4e0b164eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b164e4 expref: 19 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.580899:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540031200/0x857e02f4e0b164eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b164e4 expref: 19 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.580909:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935433.580961:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45729c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:3651:x1871640292020736:12345-0@lo:103: Request processed in 95us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935433.580966:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784935433.581110:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292021504:0@lo:103: 00000100:00100000:0.0:1784935433.581459:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935433.581644:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292020864:0@lo:103: 00000100:00100000:2.0:1784935433.581733:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292021632 00000100:00100000:2.0:1784935433.581745:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292021632 00010000:00010000:2.0:1784935433.581767:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4554020a00/0x857e02f4e0b16404 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b163fd expref: 18 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.581859:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292021376 00000100:00100000:1.0:1784935433.581863:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292021376 00010000:00010000:1.0:1784935433.581881:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4554020c00/0x857e02f4e0b1646d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16466 expref: 19 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935433.581907:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784935433.581914:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:3649:x1871640292021632:12345-0@lo:103: 00010000:00010000:1.0:1784935433.581924:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935433.581951:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4554020a00/0x857e02f4e0b16404 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b163fd expref: 19 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.581961:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4554020a00/0x857e02f4e0b16404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b163fd expref: 19 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.581973:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554020a00/0x857e02f4e0b16404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b163fd expref: 19 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.582076:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935433.582127:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:3649:x1871640292021632:12345-0@lo:103: Request processed in 213us (3789us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935433.582133:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784935433.582155:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784935433.582161:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:3652:x1871640292021376:12345-0@lo:103: 00010000:00010000:1.0:1784935433.582169:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935433.582173:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4554020c00/0x857e02f4e0b1646d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16466 expref: 17 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.582180:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4554020c00/0x857e02f4e0b1646d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16466 expref: 17 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.582189:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554020c00/0x857e02f4e0b1646d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16466 expref: 17 pid: 6520 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935433.582199:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935433.582227:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3652:x1871640292021376:12345-0@lo:103: Request processed in 67us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935433.582233:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784935433.582261:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292021376:0@lo:103: 00000100:00100000:1.0:1784935433.582281:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292021632:0@lo:103: 00000100:00100000:2.0:1784935433.582462:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935433.582534:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292020736:0@lo:103: 00000100:00100000:0.0:1784935433.582634:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292021248 00000100:00100000:0.0:1784935433.582707:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292021248 00010000:00010000:0.0:1784935433.582728:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1647b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16474 expref: 16 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935433.582862:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784935433.582871:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3651:x1871640292021248:12345-0@lo:103: 00010000:00010000:0.0:1784935433.582881:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935433.582886:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1647b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16474 expref: 16 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.582895:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1647b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16474 expref: 16 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.582906:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1647b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16474 expref: 16 pid: 6518 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.582923:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.582958:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.582974:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.582980:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.582988:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.583004:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.583010:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166b800 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935433.583014:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.583022:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.583044:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16570 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a836 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.583051:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a836 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.583076:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a836 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935433.583098:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6510:1871640292021760:192.168.203.28@tcp:105: 00000100:00100000:0.0:1784935433.583162:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433d9840 going to sleep for 11 seconds 00010000:00010000:2.0:1784935433.583365:0:10335:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.583374:0:10335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935433.591316:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935433.591348:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273097728 00000100:00100000:0.0:1784935433.591358:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273097728 00000100:00100000:0.0:1784935433.591407:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 197 00000100:00100000:0.0:1784935433.591416:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6162:x1871640273097728:12345-192.168.203.28@tcp:501: 00000100:00100000:2.0:1784935433.594716:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6510:1871640292021760:192.168.203.28@tcp:105: 00010000:00010000:2.0:1784935433.594744:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.594767:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166b800/0x857e02f4e0b16569 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935433.594793:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935433.594867:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:3651:x1871640292021248:12345-0@lo:103: Request processed in 11995us (12403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935433.594876:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784935433.594922:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292021248:0@lo:103: 00000100:00100000:0.0:1784935433.595242:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6162:x1871640273097728:12345-192.168.203.28@tcp:501: Request processed in 3826us (3935us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935433.595267:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 197 00000100:00100000:0.0:1784935433.610194:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935433.610237:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273097856 00000100:00100000:0.0:1784935433.610246:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273097856 00000100:00100000:0.0:1784935433.610293:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 198 00000100:00100000:0.0:1784935433.610303:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6162:x1871640273097856:12345-192.168.203.28@tcp:503: 00000100:00100000:0.0:1784935433.610437:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6162:x1871640273097856:12345-192.168.203.28@tcp:503: Request processed in 135us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935433.610445:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 198 00000100:00100000:2.0:1784935433.615647:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935433.616087:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273097984 00000100:00100000:1.0:1784935433.616106:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273097984 00000100:00100000:1.0:1784935433.616159:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 199 00000100:00100000:1.0:1784935433.616168:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6627:x1871640273097984:12345-192.168.203.28@tcp:502: 00000100:00100000:1.0:1784935433.616326:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6627:x1871640273097984:12345-192.168.203.28@tcp:502: Request processed in 158us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935433.616334:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 199 00000100:00100000:1.0:1784935433.626864:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935433.627017:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273098112 00000100:00100000:2.0:1784935433.627027:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273098112 00000100:00100000:2.0:1784935433.627098:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 200 00000100:00100000:2.0:1784935433.627108:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6627:x1871640273098112:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784935433.627261:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6627:x1871640273098112:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 154us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935433.627268:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 200 00000100:00100000:1.0:1784935433.638500:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935433.638594:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273098240 00000100:00100000:0.0:1784935433.638605:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273098240 00000100:00100000:0.0:1784935433.638669:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 201 00000100:00100000:0.0:1784935433.638679:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6162:x1871640273098240:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935433.638697:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935433.638714:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b16577 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a83d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.638742:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b16577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a83d expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.638762:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b16577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a83d expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935433.638772:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540031c00, rc 0) 00000100:00100000:0.0:1784935433.638835:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6162:x1871640273098240:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 Request processed in 157us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935433.638852:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 201 00000100:00100000:1.0:1784935433.646751:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935433.646959:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273098368 00000100:00100000:0.0:1784935433.646969:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273098368 00000100:00100000:0.0:1784935433.647024:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 202 00000100:00100000:0.0:1784935433.647035:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6162:x1871640273098368:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935433.647166:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6162:x1871640273098368:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 Request processed in 132us (423us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784935433.647175:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 202 00010000:00010000:2.0:1784935434.350326:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784935434.478570:0:10388:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc58f8dda0 20000000:00000080:1.0:1784935434.478586:0:10388:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d4443424c00 uarg=0000000000000000 20000000:01000000:1.0:1784935434.478632:0:10388:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784935434.478638:0:10388:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784935434.478642:0:10388:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784935434.479440:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1784935434.479582:0:10388:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1784935434.483574:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1784935434.483616:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1784935434.483634:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1784935434.483651:0:10388:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784935434.483672:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.483691:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b1629f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16298 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.483701:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4554020800/0x857e02f4e0b162ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b162a6 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.483708:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4554021000/0x857e02f4e0b162fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b162f3 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.483715:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b16420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16419 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.483725:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b16538 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7fe expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.483732:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.483903:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b16538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7fe expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.483918:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b16538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7fe expref: 9 pid: 6517 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935434.484617:0:10388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1871640292021888:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935434.484729:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b16420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16419 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.484754:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b16420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16419 expref: 14 pid: 6518 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935434.484764:0:10388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1871640292022016:0@lo:104: 00000100:00100000:1.0:1784935434.484810:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784935434.484851:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4554021000/0x857e02f4e0b162fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b162f3 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.484860:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4554021000/0x857e02f4e0b162fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b162f3 expref: 14 pid: 6520 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935434.484868:0:10388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1871640292022144:0@lo:104: 00000100:00100000:1.0:1784935434.484907:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935434.484973:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784935434.484985:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292022016 00000100:00100000:1.0:1784935434.484992:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292022016 00000100:00100000:1.0:1784935434.485028:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292022144 00000100:00100000:1.0:1784935434.485031:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292022144 00000100:00100000:1.0:1784935434.485066:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784935434.485075:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:10388:x1871640292022016:12345-0@lo:104: 00010000:00010000:1.0:1784935434.485125:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.485174:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784935434.485180:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:10388:x1871640292022016:12345-0@lo:104: Request processed in 107us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935434.485188:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784935434.485205:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784935434.485210:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443425450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10388:x1871640292022144:12345-0@lo:104: 00010000:00010000:1.0:1784935434.485218:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.485381:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784935434.485387:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443425450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10388:x1871640292022144:12345-0@lo:104: Request processed in 177us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935434.485393:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1784935434.485443:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4554020800/0x857e02f4e0b162ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b162a6 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.485452:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4554020800/0x857e02f4e0b162ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b162a6 expref: 14 pid: 6520 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935434.485461:0:10388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1871640292022272:0@lo:104: 00000100:00100000:1.0:1784935434.485482:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935434.485502:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292022272 00000100:00100000:1.0:1784935434.485506:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292022272 00000100:00100000:1.0:1784935434.485523:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784935434.485536:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10388:x1871640292022272:12345-0@lo:104: 00010000:00010000:1.0:1784935434.485544:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.485571:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784935434.485576:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10388:x1871640292022272:12345-0@lo:104: Request processed in 41us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935434.485582:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1784935434.485609:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b1629f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16298 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.485617:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b1629f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16298 expref: 14 pid: 6518 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935434.485625:0:10388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1871640292022400:0@lo:104: 00000100:00100000:1.0:1784935434.485646:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935434.485664:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292022400 00000100:00100000:1.0:1784935434.485667:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292022400 00000100:00100000:1.0:1784935434.485682:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784935434.485687:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10388:x1871640292022400:12345-0@lo:104: 00010000:00010000:1.0:1784935434.485694:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b16298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.485721:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784935434.485726:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:10388:x1871640292022400:12345-0@lo:104: Request processed in 39us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935434.485732:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784935434.485750:0:10388:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547eab840 going to sleep for 11 seconds 00000100:00100000:1.0:1784935434.485772:0:10388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1871640292022016:0@lo:104: 00000100:00100000:1.0:1784935434.485791:0:10388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1871640292022144:0@lo:104: 00000100:00100000:1.0:1784935434.485796:0:10388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1871640292022272:0@lo:104: 00000100:00100000:1.0:1784935434.485802:0:10388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1871640292022400:0@lo:104: 00010000:00010000:2.0:1784935434.485963:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784935434.485970:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.485977:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935434.485981:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.485990:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935434.485997:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935434.486003:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784935434.486032:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486039:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935434.486069:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486076:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d300800/0x857e02f4e0b16419 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16420 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486100:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784935434.486109:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486116:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030a00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935434.486119:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486126:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935434.486132:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935434.486137:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784935434.486152:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486157:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935434.486162:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486167:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4540030a00/0x857e02f4e0b162f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b162fa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486177:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784935434.486180:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486187:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529400 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935434.486189:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486206:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935434.486211:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935434.486216:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784935434.486397:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486404:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935434.486423:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486431:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4541529400/0x857e02f4e0b162a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b162ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486441:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935434.486444:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b16298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486449:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021a00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935434.486452:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b16298 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486460:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b16298 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935434.486465:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b16298 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935434.486478:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784935434.486497:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b16298 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486503:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935434.486508:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b16298 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486513:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b16298 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1629f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.486526:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935434.486528:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935434.486529:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935434.486536:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935434.486548:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292022528:0@lo:103: 00000100:00100000:2.0:1784935434.486583:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935434.486607:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784935434.486612:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292022656:0@lo:103: 00000100:00100000:2.0:1784935434.486630:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935434.486655:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292022912:0@lo:103: 00000100:00100000:2.0:1784935434.486674:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935434.486691:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935434.486696:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292022784:0@lo:103: 00000100:00100000:2.0:1784935434.486715:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935434.486740:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292022528 00000100:00100000:2.0:1784935434.487821:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292022528 00010000:00010000:2.0:1784935434.487864:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b16420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16419 expref: 15 pid: 6518 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935434.487888:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292022656 00000100:00100000:2.0:1784935434.487891:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292022656 00010000:00010000:2.0:1784935434.487902:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4554021000/0x857e02f4e0b162fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b162f3 expref: 16 pid: 6520 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935434.487911:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292022912 00000100:00100000:2.0:1784935434.487914:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292022912 00010000:00010000:2.0:1784935434.487922:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b1629f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16298 expref: 17 pid: 6518 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935434.487952:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292022784 00000100:00100000:2.0:1784935434.487955:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292022784 00010000:00010000:2.0:1784935434.487967:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4554020800/0x857e02f4e0b162ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b162a6 expref: 18 pid: 6520 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935434.487979:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784935434.487985:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:3651:x1871640292022528:12345-0@lo:103: 00010000:00010000:2.0:1784935434.487997:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935434.488002:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b16420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16419 expref: 18 pid: 6518 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.488011:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b16420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16419 expref: 18 pid: 6518 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.488025:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b16420 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16419 expref: 18 pid: 6518 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.488039:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935434.490417:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784935434.490435:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:3651:x1871640292022656:12345-0@lo:103: 00010000:00010000:3.0:1784935434.490453:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935434.490462:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4554021000/0x857e02f4e0b162fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b162f3 expref: 17 pid: 6520 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.490477:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4554021000/0x857e02f4e0b162fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b162f3 expref: 17 pid: 6520 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.490492:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554021000/0x857e02f4e0b162fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b162f3 expref: 17 pid: 6520 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.490508:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935434.491158:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3651:x1871640292022528:12345-0@lo:103: Request processed in 3168us (4569us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935434.491159:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:3651:x1871640292022656:12345-0@lo:103: Request processed in 727us (4524us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935434.491168:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784935434.491181:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784935434.491200:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784935434.491208:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784935434.491213:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:3650:x1871640292022912:12345-0@lo:103: 00000100:00100000:2.0:1784935434.491220:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45729c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:3650:x1871640292022784:12345-0@lo:103: 00010000:00010000:3.0:1784935434.491224:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935434.491232:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b1629f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16298 expref: 14 pid: 6518 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.491242:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b1629f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16298 expref: 14 pid: 6518 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.491261:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b1629f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16298 expref: 14 pid: 6518 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.491271:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935434.491305:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:3650:x1871640292022912:12345-0@lo:103: Request processed in 97us (4629us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935434.491311:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784935434.491419:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292022912:0@lo:103: 00010000:00010000:2.0:1784935434.491650:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935434.491658:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4554020800/0x857e02f4e0b162ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b162a6 expref: 12 pid: 6520 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.491669:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4554020800/0x857e02f4e0b162ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b162a6 expref: 12 pid: 6520 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.491681:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554020800/0x857e02f4e0b162ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b162a6 expref: 12 pid: 6520 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935434.491693:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935434.491727:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45729c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:3650:x1871640292022784:12345-0@lo:103: Request processed in 511us (5010us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935434.491734:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784935434.492291:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935434.492322:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273098496 00000100:00100000:3.0:1784935434.492328:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273098496 00010000:00010000:3.0:1784935434.492365:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b16538 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7fe expref: 10 pid: 6517 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935434.492389:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 39 00000100:00100000:3.0:1784935434.492398:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2392:x1871640273098496:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935434.492408:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935434.492413:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b16538 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7fe expref: 10 pid: 6517 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.492424:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b16538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7fe expref: 10 pid: 6517 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.492439:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.492448:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.492470:0:9527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.492477:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.492485:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.492492:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.492497:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166ae00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935434.492501:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.492508:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.492517:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935434.492527:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935434.492565:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2392:x1871640273098496:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 169us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935434.492572:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 39 00000100:00100000:0.0:1784935434.493484:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292022656:0@lo:103: 00000100:00100000:0.0:1784935434.493497:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292022528:0@lo:103: 00000100:00100000:2.0:1784935434.494361:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292022784:0@lo:103: 00010000:00010000:1.0:1784935434.494666:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b16538 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7fe expref: 9 pid: 6517 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935434.494683:0:10388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1871640292021888:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935434.494711:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.494722:0:10388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.494729:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935434.494736:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166ae00/0x857e02f4e0b1657e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935434.670539:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935434.670565:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292023040:0@lo:41: 00000100:00100000:2.0:1784935434.670634:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935434.670723:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292023040 00000100:00100000:3.0:1784935434.670731:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292023040 00000100:00100000:3.0:1784935434.670781:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784935434.670791:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292023040:12345-0@lo:41: 00000004:00000024:3.0:1784935434.670836:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784935434.670894:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292023040:12345-0@lo:41: Request processed in 104us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935434.670901:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784935434.671005:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292023040:0@lo:41: 10000000:01000000:3.0:1784935435.373645:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784935435.373652:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d457d24e000 from 48 10000000:01000000:3.0:1784935435.373657:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784935435.373702:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.373714:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.373726:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935435.373751:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292023168:0@lo:101: 00000100:00100000:3.0:1784935435.373820:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.373874:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a300 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.373961:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292023168 00000100:00100000:2.0:1784935435.373969:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292023168 00000100:00100000:2.0:1784935435.374020:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784935435.374029:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+11:6523:x1871640292023168:12345-0@lo:101: 00010000:00010000:2.0:1784935435.374043:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935435.374063:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d300600/0x857e02f4e0b1658c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16585 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.374211:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d300600/0x857e02f4e0b1658c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16585 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.374223:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d300600/0x857e02f4e0b1658c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16585 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.374232:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300600, rc 0) 00000100:00100000:2.0:1784935435.374315:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6523:x1871640292023168:12345-0@lo:101: Request processed in 287us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.374322:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1784935435.375696:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292023168:0@lo:101: 00010000:00010000:3.0:1784935435.375719:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.375729:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935435.375806:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292023296:0@lo:501: 00000100:00100000:3.0:1784935435.375851:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.375960:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a300 going to sleep for 11 seconds 00010000:00010000:2.0:1784935435.376162:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935435.376228:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292023296 00000100:00100000:1.0:1784935435.376235:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292023296 00000100:00100000:1.0:1784935435.376314:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1784935435.376323:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6523:x1871640292023296:12345-0@lo:501: 00000100:00100000:1.0:1784935435.376464:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6523:x1871640292023296:12345-0@lo:501: Request processed in 142us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.376471:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784935435.376534:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292023296:0@lo:501: 00000100:00100000:3.0:1784935435.376563:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292023424:0@lo:503: 00000100:00100000:3.0:1784935435.376601:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.376665:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a300 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.376720:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292023424 00000100:00100000:2.0:1784935435.376725:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292023424 00000100:00100000:2.0:1784935435.376750:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1784935435.376757:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6523:x1871640292023424:12345-0@lo:503: 00000100:00100000:2.0:1784935435.376842:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6523:x1871640292023424:12345-0@lo:503: Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.376849:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1784935435.377007:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292023424:0@lo:503: 00000100:00100000:3.0:1784935435.377471:0:10419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10419:1871640292023552:0@lo:502: 00000100:00100000:3.0:1784935435.377508:0:10419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.377537:0:10419:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.377582:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292023552 00000100:00100000:2.0:1784935435.377587:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292023552 00000100:00100000:2.0:1784935435.377607:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1784935435.377614:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:10419:x1871640292023552:12345-0@lo:502: 00000100:00100000:2.0:1784935435.377702:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:10419:x1871640292023552:12345-0@lo:502: Request processed in 87us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.377708:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1784935435.377777:0:10419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10419:1871640292023552:0@lo:502: 00000100:00100000:3.0:1784935435.377812:0:10419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10419:1871640292023680:0@lo:502: 00000100:00100000:3.0:1784935435.377842:0:10419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.377864:0:10419:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.377913:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292023680 00000100:00100000:2.0:1784935435.377924:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292023680 00000100:00100000:2.0:1784935435.377974:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1784935435.377979:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:10419:x1871640292023680:12345-0@lo:502: 00000100:00100000:2.0:1784935435.378038:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:10419:x1871640292023680:12345-0@lo:502: Request processed in 58us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.378044:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1784935435.378232:0:10419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10419:1871640292023680:0@lo:502: 00000040:00080000:3.0:1784935435.378252:0:10419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784935435.378381:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1784935435.378404:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784935435.378414:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.378423:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935435.378432:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784935435.378435:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1784935435.378438:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784935435.378460:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.378468:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.378477:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935435.378488:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292023808:0@lo:101: 00000100:00100000:2.0:1784935435.378515:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.378543:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70180 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.378591:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292023808 00000100:00100000:3.0:1784935435.378596:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292023808 00000100:00100000:3.0:1784935435.378616:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1784935435.378622:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+12:6523:x1871640292023808:12345-0@lo:101: 00010000:00010000:3.0:1784935435.378631:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935435.378642:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541529800/0x857e02f4e0b1659a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16593 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.378662:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541529800/0x857e02f4e0b1659a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16593 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.378681:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541529800/0x857e02f4e0b1659a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16593 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.378690:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529800, rc 0) 00000100:00100000:3.0:1784935435.378731:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:6523:x1871640292023808:12345-0@lo:101: Request processed in 108us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.378736:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784935435.378804:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292023808:0@lo:101: 00010000:00010000:2.0:1784935435.378822:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.378830:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935435.378872:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292023936:0@lo:501: 00000100:00100000:2.0:1784935435.378896:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.378917:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70180 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.379005:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292023936 00000100:00100000:3.0:1784935435.379009:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292023936 00000100:00100000:3.0:1784935435.379028:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1784935435.379034:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:6523:x1871640292023936:12345-0@lo:501: 00000100:00100000:3.0:1784935435.379269:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:6523:x1871640292023936:12345-0@lo:501: Request processed in 234us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.379276:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1784935435.379388:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292023936:0@lo:501: 00000100:00100000:2.0:1784935435.379413:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292024064:0@lo:503: 00000100:00100000:2.0:1784935435.379449:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.379477:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70180 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.379525:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292024064 00000100:00100000:3.0:1784935435.379529:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292024064 00000100:00100000:3.0:1784935435.379557:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1784935435.379563:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:6523:x1871640292024064:12345-0@lo:503: 00000100:00100000:3.0:1784935435.379643:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:6523:x1871640292024064:12345-0@lo:503: Request processed in 79us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.379650:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1784935435.379744:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292024064:0@lo:503: 00000100:00100000:2.0:1784935435.380503:0:10420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10420:1871640292024192:0@lo:502: 00000100:00100000:2.0:1784935435.380546:0:10420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.380602:0:10420:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70540 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.380636:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292024192 00000100:00100000:3.0:1784935435.380641:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292024192 00000100:00100000:3.0:1784935435.380706:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1784935435.380714:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:10420:x1871640292024192:12345-0@lo:502: 00000100:00100000:3.0:1784935435.380844:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:10420:x1871640292024192:12345-0@lo:502: Request processed in 130us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.380856:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1784935435.381364:0:10420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10420:1871640292024192:0@lo:502: 00000020:01000000:2.0:1784935435.381389:0:10420:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935435.381397:0:10420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935435.381399:0:10420:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784935435.381405:0:10420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784935435.381429:0:10420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10420:1871640292024320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935435.381464:0:10420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.381491:0:10420:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70540 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.381540:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292024320 00000100:00100000:0.0:1784935435.381545:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292024320 00000100:00100000:0.0:1784935435.381613:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1784935435.381621:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:10420:x1871640292024320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.381710:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:10420:x1871640292024320:12345-0@lo:502:llog_process_th.0 Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.381717:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1784935435.381786:0:10420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10420:1871640292024320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784935435.381809:0:10420:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935435.381814:0:10420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935435.381816:0:10420:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784935435.381819:0:10420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1784935435.381981:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1784935435.382000:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784935435.382010:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.382020:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935435.382038:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784935435.382041:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457d24e000 from 4 10000000:01000000:0.0:1784935435.382043:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784935435.382191:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.382200:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.382209:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935435.382223:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292024448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.382253:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.382269:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433d90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.382330:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292024448 00000100:00100000:3.0:1784935435.382335:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292024448 00000100:00100000:3.0:1784935435.382359:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1784935435.382365:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+13:6523:x1871640292024448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935435.382375:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935435.382387:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b165a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b165a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.382407:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b165a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b165a1 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.382417:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b165a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b165a1 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.382426:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529c00, rc 0) 00000100:00100000:3.0:1784935435.382465:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:6523:x1871640292024448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.382471:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1784935435.382557:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292024448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935435.382569:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.382578:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935435.382639:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292024576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.382663:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.382688:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433d90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.382722:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292024576 00000100:00100000:3.0:1784935435.382726:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292024576 00000100:00100000:3.0:1784935435.382750:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1784935435.382756:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:6523:x1871640292024576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784935435.382902:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:6523:x1871640292024576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.382909:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1784935435.383248:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292024576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.383276:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292024704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.383317:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.383369:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433d90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.383400:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292024704 00000100:00100000:2.0:1784935435.383404:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292024704 00000100:00100000:2.0:1784935435.383463:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1784935435.383471:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:6523:x1871640292024704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.383555:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:6523:x1871640292024704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.383561:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1784935435.383620:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292024704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.383965:0:10421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10421:1871640292024832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.384000:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.384319:0:10421:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433d9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.384384:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292024832 00000100:00100000:3.0:1784935435.384397:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292024832 00000100:00100000:3.0:1784935435.384422:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1784935435.384429:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:10421:x1871640292024832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935435.384524:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:10421:x1871640292024832:12345-0@lo:502:llog_process_th.0 Request processed in 95us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.384532:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1784935435.384599:0:10421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10421:1871640292024832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784935435.384623:0:10421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784935435.384632:0:10421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935435.384634:0:10421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784935435.384641:0:10421:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d457d24e000 00000020:00000080:0.0:1784935435.384644:0:10421:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784935435.384719:0:10421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10421:1871640292024960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.384753:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.384765:0:10421:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433d9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.387189:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292024960 00000100:00100000:3.0:1784935435.387205:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292024960 00000100:00100000:3.0:1784935435.387253:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1784935435.387262:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:10421:x1871640292024960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935435.391244:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:10421:x1871640292024960:12345-0@lo:502:llog_process_th.0 Request processed in 3973us (6481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.391258:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1784935435.391432:0:10421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10421:1871640292024960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784935435.391472:0:10421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935435.391479:0:10421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935435.391481:0:10421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784935435.391487:0:10421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784935435.391755:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784935435.391782:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784935435.391800:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.391811:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935435.391820:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784935435.391823:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d457b962000 from 48 10000000:01000000:1.0:1784935435.391825:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784935435.391856:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.391864:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.391874:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.391892:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.391982:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.392014:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547eab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.392195:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292025088 00000100:00100000:0.0:1784935435.392201:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292025088 00000100:00100000:0.0:1784935435.392243:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1784935435.392252:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+14:6523:x1871640292025088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935435.392266:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935435.392278:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4540030a00/0x857e02f4e0b165b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b165af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.392309:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4540030a00/0x857e02f4e0b165b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b165af expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.392319:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4540030a00/0x857e02f4e0b165b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b165af expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.392327:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540030a00, rc 0) 00000100:00100000:0.0:1784935435.392373:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640292025088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.392380:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1784935435.392446:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784935435.392460:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.392469:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935435.392523:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.392549:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.392571:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70000 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.392612:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292025216 00000100:00100000:0.0:1784935435.392616:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292025216 00000100:00100000:0.0:1784935435.392645:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1784935435.392652:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640292025216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.392751:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640292025216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.392757:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1784935435.392816:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.392841:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.392879:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.392901:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70000 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.392960:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292025344 00000100:00100000:0.0:1784935435.392965:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292025344 00000100:00100000:0.0:1784935435.392989:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1784935435.392996:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640292025344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.393090:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640292025344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.393096:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1784935435.393241:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.393540:0:10424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10424:1871640292025472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935435.393576:0:10424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.393597:0:10424:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.393663:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292025472 00000100:00100000:1.0:1784935435.393669:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292025472 00000100:00100000:1.0:1784935435.393704:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784935435.393713:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:10424:x1871640292025472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.393796:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:10424:x1871640292025472:12345-0@lo:502:llog_process_th.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.393803:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1784935435.393878:0:10424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10424:1871640292025472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935435.393913:0:10424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10424:1871640292025600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935435.393975:0:10424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.393993:0:10424:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.394037:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292025600 00000100:00100000:0.0:1784935435.394041:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292025600 00000100:00100000:0.0:1784935435.394090:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784935435.394097:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:10424:x1871640292025600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.394165:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:10424:x1871640292025600:12345-0@lo:502:llog_process_th.0 Request processed in 68us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.394172:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1784935435.394297:0:10424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10424:1871640292025600:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784935435.394317:0:10424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784935435.394491:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1784935435.394512:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784935435.394521:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.394531:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935435.394541:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784935435.394543:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1784935435.394545:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784935435.394569:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.394577:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.394586:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935435.394599:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.394626:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.394653:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f03000 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.394697:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292025728 00000100:00100000:1.0:1784935435.394707:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292025728 00000100:00100000:1.0:1784935435.394740:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784935435.394746:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+15:6523:x1871640292025728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935435.394754:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935435.394766:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d454166a800/0x857e02f4e0b165c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b165bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.394786:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d454166a800/0x857e02f4e0b165c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b165bd expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.394795:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d454166a800/0x857e02f4e0b165c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b165bd expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.394802:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d454166a800, rc 0) 00000100:00100000:1.0:1784935435.394838:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292025728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.394844:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1784935435.394966:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935435.394985:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.394993:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935435.395160:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.395186:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.395196:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f03000 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.395239:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292025856 00000100:00100000:1.0:1784935435.395244:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292025856 00000100:00100000:1.0:1784935435.395272:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1784935435.395277:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292025856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.395429:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292025856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.395436:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1784935435.396555:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.396605:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.396655:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.396725:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.398158:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292025984 00000100:00100000:0.0:1784935435.398172:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292025984 00000100:00100000:0.0:1784935435.398283:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1784935435.398294:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292025984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.398455:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292025984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.398463:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1784935435.398552:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292025984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784935435.398807:0:10425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10425:1871640292026112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935435.398852:0:10425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.404237:0:10425:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e1fa600 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.404274:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292026112 00000100:00100000:2.0:1784935435.404283:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292026112 00000100:00100000:1.0:1784935435.404351:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1784935435.404362:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:10425:x1871640292026112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.404524:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:10425:x1871640292026112:12345-0@lo:502:llog_process_th.0 Request processed in 164us (5671us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.404538:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1784935435.405630:0:10425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10425:1871640292026112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784935435.405672:0:10425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935435.405683:0:10425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935435.405685:0:10425:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784935435.405694:0:10425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784935435.405735:0:10425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10425:1871640292026240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935435.405788:0:10425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.405833:0:10425:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e1fa600 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.406301:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292026240 00000100:00100000:0.0:1784935435.406309:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292026240 00000100:00100000:0.0:1784935435.406359:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1784935435.406368:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:10425:x1871640292026240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.406484:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:10425:x1871640292026240:12345-0@lo:502:llog_process_th.0 Request processed in 117us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.406492:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1784935435.407180:0:10425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10425:1871640292026240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784935435.407217:0:10425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935435.407223:0:10425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935435.407225:0:10425:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784935435.407231:0:10425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1784935435.407295:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1784935435.407317:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784935435.407327:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.407339:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935435.407348:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784935435.407350:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457b962000 from 4 10000000:01000000:3.0:1784935435.407353:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784935435.407379:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.407387:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.407396:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935435.407414:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292026368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784935435.407452:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.407482:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e1fa600 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.407496:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292026368 00000100:00100000:3.0:1784935435.407501:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292026368 00000100:00100000:3.0:1784935435.407526:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784935435.407542:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+16:6523:x1871640292026368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935435.407554:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935435.407566:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541528200/0x857e02f4e0b165d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b165cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.407586:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541528200/0x857e02f4e0b165d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b165cb expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.407597:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541528200/0x857e02f4e0b165d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b165cb expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.407605:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541528200, rc 0) 00000100:00100000:3.0:1784935435.407639:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292026368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.407645:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784935435.407674:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292026368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935435.407685:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935435.407694:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935435.407739:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292026496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784935435.407763:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.407776:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e1fa600 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.407786:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292026496 00000100:00100000:3.0:1784935435.407789:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292026496 00000100:00100000:3.0:1784935435.407804:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784935435.407817:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292026496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784935435.407907:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292026496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.407913:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784935435.407962:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292026496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784935435.407987:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292026624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784935435.408022:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.408041:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e1fa600 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.408137:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292026624 00000100:00100000:3.0:1784935435.408141:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292026624 00000100:00100000:3.0:1784935435.408161:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784935435.408167:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292026624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784935435.408239:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292026624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.408246:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784935435.408281:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292026624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784935435.410711:0:10426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10426:1871640292026752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935435.410783:0:10426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.410851:0:10426:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1bbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.410885:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292026752 00000100:00100000:1.0:1784935435.410891:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292026752 00000100:00100000:1.0:1784935435.411147:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1784935435.411157:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:10426:x1871640292026752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.411304:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:10426:x1871640292026752:12345-0@lo:502:llog_process_th.0 Request processed in 148us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.411312:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784935435.411397:0:10426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10426:1871640292026752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784935435.411424:0:10426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935435.411433:0:10426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935435.411435:0:10426:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784935435.411443:0:10426:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d457b962000 00000020:00000080:3.0:1784935435.411452:0:10426:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784935435.411570:0:10426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10426:1871640292026880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935435.411605:0:10426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935435.411635:0:10426:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1bbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.411675:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292026880 00000100:00100000:2.0:1784935435.411679:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292026880 00000100:00100000:2.0:1784935435.411712:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1784935435.411719:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:10426:x1871640292026880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935435.411807:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:10426:x1871640292026880:12345-0@lo:502:llog_process_th.0 Request processed in 87us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.411814:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1784935435.411878:0:10426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10426:1871640292026880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784935435.411895:0:10426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935435.411899:0:10426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935435.411900:0:10426:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784935435.411904:0:10426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784935435.412187:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784935435.412205:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784935435.412214:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.412226:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935435.412235:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784935435.412237:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4570c47800 from 48 10000000:01000000:1.0:1784935435.412240:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784935435.412263:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.412271:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.412280:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.412294:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.412331:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.412387:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4561fb30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.418110:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292027008 00000100:00100000:2.0:1784935435.418124:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292027008 00000100:00100000:2.0:1784935435.418185:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1784935435.418194:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+17:6523:x1871640292027008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784935435.418211:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935435.418228:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d301800/0x857e02f4e0b165e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b165d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.418253:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d301800/0x857e02f4e0b165e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b165d9 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.418264:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d301800/0x857e02f4e0b165e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b165d9 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.418273:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d301800, rc 0) 00000100:00100000:2.0:1784935435.420472:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292027008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2269us (8130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.420483:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1784935435.421485:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784935435.421511:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.421524:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935435.421690:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.421749:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.421790:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.421810:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292027136 00000100:00100000:2.0:1784935435.421815:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292027136 00000100:00100000:2.0:1784935435.421859:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784935435.421867:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292027136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.422007:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292027136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.422015:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784935435.422049:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.422075:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.422126:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.422145:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.422157:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292027264 00000100:00100000:2.0:1784935435.422160:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292027264 00000100:00100000:2.0:1784935435.422182:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784935435.422188:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292027264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.422259:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292027264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.422266:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784935435.422305:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.427764:0:10429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10429:1871640292027392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.427849:0:10429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.427889:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292027392 00000100:00100000:0.0:1784935435.427902:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292027392 00000100:00100000:0.0:1784935435.428841:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1784935435.428852:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:10429:x1871640292027392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.429816:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:10429:x1871640292027392:12345-0@lo:502:llog_process_th.0 Request processed in 963us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.429825:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1784935435.429899:0:10429:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.429922:0:10429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10429:1871640292027392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.430242:0:10429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10429:1871640292027520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.430601:0:10429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.430640:0:10429:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f03b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.430774:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292027520 00000100:00100000:3.0:1784935435.430784:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292027520 00000100:00100000:3.0:1784935435.430956:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1784935435.430965:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:10429:x1871640292027520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935435.431112:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:10429:x1871640292027520:12345-0@lo:502:llog_process_th.0 Request processed in 148us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935435.431120:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1784935435.435219:0:10429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10429:1871640292027520:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784935435.435262:0:10429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784935435.435360:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1784935435.435379:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784935435.435390:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.435401:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935435.435410:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1784935435.435413:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1784935435.435415:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784935435.435445:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.435464:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.435474:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935435.435494:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.435551:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.435584:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.435600:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292027648 00000100:00100000:0.0:1784935435.435605:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292027648 00000100:00100000:0.0:1784935435.435648:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1784935435.435657:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+18:6523:x1871640292027648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935435.435670:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935435.435683:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4540030400/0x857e02f4e0b165ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b165e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.435707:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4540030400/0x857e02f4e0b165ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b165e7 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.435717:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4540030400/0x857e02f4e0b165ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b165e7 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.435725:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540030400, rc 0) 00000100:00100000:0.0:1784935435.435765:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640292027648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.435772:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1784935435.435821:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935435.435833:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935435.435842:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935435.435892:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.435915:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.435956:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.435968:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292027776 00000100:00100000:0.0:1784935435.435972:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292027776 00000100:00100000:0.0:1784935435.435994:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1784935435.436000:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640292027776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.436123:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640292027776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.436129:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1784935435.436155:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.436176:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.436210:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935435.436221:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.436231:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292027904 00000100:00100000:0.0:1784935435.436234:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292027904 00000100:00100000:0.0:1784935435.436252:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1784935435.436258:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640292027904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.436321:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640292027904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.436331:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1784935435.436363:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292027904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.443552:0:10432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10432:1871640292028032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.443639:0:10432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.443684:0:10432:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4561fb30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.445119:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292028032 00000100:00100000:0.0:1784935435.445132:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292028032 00000100:00100000:0.0:1784935435.445335:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1784935435.445345:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:10432:x1871640292028032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.445507:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:10432:x1871640292028032:12345-0@lo:502:llog_process_th.0 Request processed in 163us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.445514:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1784935435.456242:0:10432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10432:1871640292028032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935435.456289:0:10432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935435.456299:0:10432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935435.456302:0:10432:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784935435.456309:0:10432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784935435.456414:0:10432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10432:1871640292028160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.456492:0:10432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.456531:0:10432:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541abe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.456587:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292028160 00000100:00100000:0.0:1784935435.456594:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292028160 00000100:00100000:0.0:1784935435.456650:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784935435.456660:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:10432:x1871640292028160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.457012:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:10432:x1871640292028160:12345-0@lo:502:llog_process_th.0 Request processed in 353us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.457020:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1784935435.458746:0:10432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10432:1871640292028160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935435.458790:0:10432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935435.458798:0:10432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935435.458800:0:10432:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784935435.458806:0:10432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1784935435.458963:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1784935435.458985:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784935435.458995:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.459006:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935435.459015:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784935435.459025:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4570c47800 from 4 10000000:01000000:1.0:1784935435.459028:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784935435.459422:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.459431:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.459440:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.459462:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292028288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.459518:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.459551:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541abe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.459570:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292028288 00000100:00100000:1.0:1784935435.459576:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292028288 00000100:00100000:1.0:1784935435.459616:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1784935435.459624:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:6523:x1871640292028288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935435.459637:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935435.459649:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b165fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b165f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.459671:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b165fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b165f5 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.459682:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b165fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b165f5 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.459690:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d454166aa00, rc 0) 00000100:00100000:1.0:1784935435.459724:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292028288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.459738:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1784935435.459792:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292028288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935435.459806:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.459815:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.459861:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292028416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.459885:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.459898:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541abe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.459910:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292028416 00000100:00100000:1.0:1784935435.459913:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292028416 00000100:00100000:1.0:1784935435.459955:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1784935435.459962:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292028416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.460075:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292028416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.460092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1784935435.460123:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292028416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.460148:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292028544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.460186:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.460198:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541abe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.460211:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292028544 00000100:00100000:1.0:1784935435.460215:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292028544 00000100:00100000:1.0:1784935435.460237:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1784935435.460249:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292028544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.460329:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292028544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.460534:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1784935435.460577:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292028544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.460746:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10433:1871640292028672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.460839:0:10433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.460858:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292028672 00000100:00100000:1.0:1784935435.460862:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292028672 00000100:00100000:1.0:1784935435.460882:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784935435.460888:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:10433:x1871640292028672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.460978:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:10433:x1871640292028672:12345-0@lo:502:llog_process_th.0 Request processed in 89us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.460984:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784935435.461013:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549153cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.461025:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10433:1871640292028672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935435.461118:0:10433:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935435.461127:0:10433:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935435.461129:0:10433:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784935435.461139:0:10433:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4570c47800 00000020:00000080:1.0:1784935435.461142:0:10433:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784935435.461213:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10433:1871640292028800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.461247:0:10433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.461267:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292028800 00000100:00100000:1.0:1784935435.461271:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292028800 00000100:00100000:1.0:1784935435.461300:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1784935435.461305:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:10433:x1871640292028800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.461558:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:10433:x1871640292028800:12345-0@lo:502:llog_process_th.0 Request processed in 252us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.461565:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1784935435.461592:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549153cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.461603:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10433:1871640292028800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935435.461619:0:10433:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935435.461623:0:10433:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935435.461625:0:10433:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784935435.461628:0:10433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784935435.461676:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784935435.461692:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784935435.461701:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.461712:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935435.462437:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784935435.462442:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4570329000 from 48 10000000:01000000:1.0:1784935435.462446:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784935435.462476:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.462484:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.462493:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.462516:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292028928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.462555:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.462582:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4543674cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.462601:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292028928 00000100:00100000:1.0:1784935435.462607:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292028928 00000100:00100000:1.0:1784935435.462640:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784935435.462648:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292028928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935435.462660:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935435.462672:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d454166a200/0x857e02f4e0b1660a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16603 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.462694:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d454166a200/0x857e02f4e0b1660a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16603 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.462704:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d454166a200/0x857e02f4e0b1660a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16603 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.462712:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d454166a200, rc 0) 00000100:00100000:1.0:1784935435.462759:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292028928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.464179:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784935435.464263:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292028928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935435.464283:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.464295:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.464463:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292029056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.464509:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.464542:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4543674cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.464557:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292029056 00000100:00100000:1.0:1784935435.464561:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292029056 00000100:00100000:1.0:1784935435.464591:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1784935435.464598:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292029056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.464709:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292029056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.464716:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1784935435.464744:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292029056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.467165:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292029184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.467255:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.467296:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4543674cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.467320:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292029184 00000100:00100000:1.0:1784935435.467327:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292029184 00000100:00100000:1.0:1784935435.467383:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784935435.467392:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292029184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.467503:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292029184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.467511:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784935435.467568:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292029184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.483291:0:10435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10435:1871640292029312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.483386:0:10435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.483422:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292029312 00000100:00100000:1.0:1784935435.483428:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292029312 00000100:00100000:1.0:1784935435.483470:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784935435.483479:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:10435:x1871640292029312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.483592:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:10435:x1871640292029312:12345-0@lo:502:llog_process_th.0 Request processed in 114us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.483599:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784935435.483647:0:10435:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541abe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.483666:0:10435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10435:1871640292029312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.483704:0:10435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10435:1871640292029440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.483731:0:10435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.483750:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292029440 00000100:00100000:1.0:1784935435.483753:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292029440 00000100:00100000:1.0:1784935435.484147:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784935435.484155:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:10435:x1871640292029440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.484214:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:10435:x1871640292029440:12345-0@lo:502:llog_process_th.0 Request processed in 60us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.484221:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784935435.484251:0:10435:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474299c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.484262:0:10435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10435:1871640292029440:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784935435.484281:0:10435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1784935435.484839:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1784935435.484861:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784935435.484871:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.484897:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935435.484907:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784935435.484909:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1784935435.484912:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784935435.484965:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.484974:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.484984:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.485000:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292029568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.485034:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.485124:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474299c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.485144:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292029568 00000100:00100000:1.0:1784935435.485149:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292029568 00000100:00100000:1.0:1784935435.485179:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1784935435.485186:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292029568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935435.485196:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935435.485208:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4442a6c400/0x857e02f4e0b16618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16611 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.485230:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4442a6c400/0x857e02f4e0b16618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16611 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.485251:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4442a6c400/0x857e02f4e0b16618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16611 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.485260:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6c400, rc 0) 00000100:00100000:1.0:1784935435.485287:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292029568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.485293:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1784935435.485325:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292029568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935435.485409:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.485419:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.485472:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292029696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.485498:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.485512:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474299c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.485525:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292029696 00000100:00100000:1.0:1784935435.485529:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292029696 00000100:00100000:1.0:1784935435.485550:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1784935435.485555:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292029696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.485649:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292029696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.485656:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1784935435.485684:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292029696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.485721:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292029824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.485755:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.485849:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474299c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.485863:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292029824 00000100:00100000:1.0:1784935435.485866:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292029824 00000100:00100000:1.0:1784935435.485888:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784935435.485894:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292029824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.485990:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292029824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.485997:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784935435.486036:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292029824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.489310:0:10437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10437:1871640292029952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.489897:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.489972:0:10437:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4554444300 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.490649:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292029952 00000100:00100000:2.0:1784935435.490658:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292029952 00000100:00100000:2.0:1784935435.490712:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1784935435.490722:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:10437:x1871640292029952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935435.490911:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:10437:x1871640292029952:12345-0@lo:502:llog_process_th.0 Request processed in 190us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.490920:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784935435.491327:0:10437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10437:1871640292029952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935435.492480:0:10437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935435.492493:0:10437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935435.492496:0:10437:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784935435.492503:0:10437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784935435.492543:0:10437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10437:1871640292030080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935435.492608:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.492752:0:10437:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4554444300 going to sleep for 11 seconds 00000100:00100000:0.0:1784935435.499358:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292030080 00000100:00100000:0.0:1784935435.499375:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292030080 00000100:00100000:0.0:1784935435.499438:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1784935435.499449:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:10437:x1871640292030080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.499631:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:10437:x1871640292030080:12345-0@lo:502:llog_process_th.0 Request processed in 184us (7022us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.499640:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1784935435.500004:0:10437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10437:1871640292030080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784935435.500060:0:10437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935435.500068:0:10437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935435.500071:0:10437:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784935435.500085:0:10437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1784935435.500307:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1784935435.500330:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784935435.500466:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.500485:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935435.500494:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784935435.500496:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4570329000 from 4 10000000:01000000:1.0:1784935435.500499:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784935435.500530:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.500539:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.500549:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.500570:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292030208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.500615:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.500647:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4554444300 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.504003:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292030208 00000100:00100000:2.0:1784935435.504019:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292030208 00000100:00100000:2.0:1784935435.504437:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1784935435.504448:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292030208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784935435.504463:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935435.504481:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d300800/0x857e02f4e0b16626 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1661f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.504508:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d300800/0x857e02f4e0b16626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1661f expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.504521:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d300800/0x857e02f4e0b16626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1661f expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.504529:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300800, rc 0) 00000100:00100000:2.0:1784935435.504608:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292030208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.504615:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1784935435.504780:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935435.504860:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273098624 00000100:00100000:2.0:1784935435.504866:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273098624 00000100:00100000:2.0:1784935435.504897:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 259 00000100:00100000:2.0:1784935435.504903:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:6162:x1871640273098624:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784935435.504911:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935435.504920:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b1662d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a844 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.504966:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b1662d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a844 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.504974:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b1662d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a844 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.504981:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d301a00, rc 0) 00000100:00100000:2.0:1784935435.505024:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6162:x1871640273098624:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 Request processed in 120us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.505031:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 259 00000100:00100000:1.0:1784935435.505170:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292030208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935435.505188:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.505198:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.505272:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292030336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.505304:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.505410:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292030336 00000100:00100000:2.0:1784935435.505415:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292030336 00000100:00100000:2.0:1784935435.505434:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1784935435.505440:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292030336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.505549:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292030336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.505556:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784935435.506129:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4554444300 going to sleep for 11 seconds 00000100:00100000:1.0:1784935435.506149:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292030336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.506183:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292030464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.506229:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.506250:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4554444300 going to sleep for 11 seconds 00000100:00100000:3.0:1784935435.507757:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935435.508543:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292030464 00000100:00100000:2.0:1784935435.508554:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292030464 00000100:00100000:2.0:1784935435.508598:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273098752 00000100:00100000:2.0:1784935435.508602:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273098752 00000100:00100000:2.0:1784935435.508619:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1784935435.508627:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292030464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.508763:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292030464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.508771:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1784935435.508816:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 262 00000100:00100000:2.0:1784935435.508823:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6162:x1871640273098752:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.508916:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6162:x1871640273098752:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 Request processed in 93us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.508923:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 262 00000100:00100000:1.0:1784935435.509516:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292030464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.509830:0:10440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10440:1871640292030592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935435.509880:0:10440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.509907:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292030592 00000100:00100000:2.0:1784935435.509911:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292030592 00000100:00100000:2.0:1784935435.509969:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784935435.509977:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:10440:x1871640292030592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935435.511646:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:10440:x1871640292030592:12345-0@lo:502:llog_process_th.0 Request processed in 1661us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.511659:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784935435.512277:0:10440:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.512308:0:10440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10440:1871640292030592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935435.514508:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935435.514550:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273098880 00000100:00100000:0.0:1784935435.514558:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273098880 00000100:00100000:0.0:1784935435.514605:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 264 00000100:00100000:0.0:1784935435.514615:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6162:x1871640273098880:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935435.514748:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6162:x1871640273098880:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 Request processed in 134us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.514756:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 264 00000020:01000000:2.0:1784935435.514850:0:10440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935435.514862:0:10440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935435.514864:0:10440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784935435.514873:0:10440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4570329000 00000020:00000080:2.0:1784935435.514876:0:10440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784935435.514993:0:10440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10440:1871640292030720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935435.515044:0:10440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935435.515070:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292030720 00000100:00100000:2.0:1784935435.515073:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292030720 00000100:00100000:2.0:1784935435.515107:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784935435.515119:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:10440:x1871640292030720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935435.515188:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:10440:x1871640292030720:12345-0@lo:502:llog_process_th.0 Request processed in 68us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.515194:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784935435.515236:0:10440:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.515258:0:10440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:10440:1871640292030720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784935435.515280:0:10440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935435.515284:0:10440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935435.515286:0:10440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784935435.515290:0:10440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784935435.518272:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784935435.518306:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784935435.518319:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.518331:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935435.518406:0:6523:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784935435.518409:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d4572a3b380 from 1 10000000:01000000:1.0:1784935435.518412:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784935435.518451:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d000/0x857e02f4e0b16634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.518459:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d000/0x857e02f4e0b16634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.518470:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d000/0x857e02f4e0b16634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.518497:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292030848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.518565:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.518620:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4554444300 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.518837:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292030848 00000100:00100000:2.0:1784935435.518845:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292030848 00000100:00100000:2.0:1784935435.518890:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784935435.518899:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292030848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784935435.518912:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935435.518954:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1663b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16634 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.518976:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1663b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16634 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.518986:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1663b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16634 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935435.518995:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300a00, rc 0) 00000100:00100000:2.0:1784935435.519035:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292030848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.519041:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1784935435.519193:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292030848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935435.519207:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d000/0x857e02f4e0b16634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1663b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.519216:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d000/0x857e02f4e0b16634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1663b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935435.519273:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292030976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935435.519299:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935435.520311:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4554444300 going to sleep for 11 seconds 00000100:00100000:2.0:1784935435.525437:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292030976 00000100:00100000:2.0:1784935435.525453:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292030976 00000100:00100000:2.0:1784935435.525510:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1784935435.525521:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292030976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935435.525640:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292030976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (6340us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784935435.525647:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784935435.526208:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292030976:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784935435.526250:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784935435.526260:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d000/0x857e02f4e0b16634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1663b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935435.526271:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d000/0x857e02f4e0b16634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1663b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935435.526718:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935435.526800:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273099008 00000100:00100000:0.0:1784935435.526805:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273099008 00000100:00100000:0.0:1784935435.526838:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 268 00000100:00100000:0.0:1784935435.526845:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6687:x1871640273099008:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784935435.526965:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6687:x1871640273099008:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 120us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.526973:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 268 00000100:00100000:0.0:1784935435.543309:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935435.543910:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273099136 00000100:00100000:0.0:1784935435.543921:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273099136 00000100:00100000:0.0:1784935435.543989:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 269 00000100:00100000:0.0:1784935435.543999:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6687:x1871640273099136:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784935435.549695:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:6687:x1871640273099136:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 5687us (6384us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.549708:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 269 00000100:00100000:0.0:1784935435.944702:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935435.944852:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273099264 00000100:00100000:3.0:1784935435.944863:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273099264 00000100:00080000:0.0:1784935435.944916:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935435.944973:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:2.0:1784935435.945227:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273099264:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935435.945310:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273099264:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 327us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935435.945319:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:3.0:1784935435.951566:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935435.951604:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935435.951679:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273099392 00000100:00100000:1.0:1784935435.951689:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273099392 00000100:00100000:1.0:1784935435.951765:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 54 00000100:00100000:1.0:1784935435.951775:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273099392:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935435.951859:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273099392:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 85us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935435.951879:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 54 00000100:00080000:3.0:1784935435.952022:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935435.952135:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273099648 00000100:00100000:0.0:1784935435.952141:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273099648 00000100:00100000:0.0:1784935435.952190:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00100000:0.0:1784935435.952197:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273099648:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935435.952235:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273099648:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 38us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.952248:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00080000:3.0:1784935435.952325:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935435.953195:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935435.954275:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273099520 00000100:00100000:0.0:1784935435.954287:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273099520 00000100:00100000:0.0:1784935435.954404:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:0.0:1784935435.954413:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273099520:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935435.954492:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273099520:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 80us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935435.954500:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00080000:3.0:1784935435.955832:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784935436.205311:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292031232:0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.205377:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935436.205423:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292031744:0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.205446:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935436.205468:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292032256:0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.205490:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935436.205521:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784935436.205527:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292031360:0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.205550:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935436.205569:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292031872:0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.205588:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935436.205601:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292032384:0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.205619:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935436.205645:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292031232 00000100:00100000:0.0:1784935436.205652:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292031232 00000100:00100000:0.0:1784935436.205699:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292031744 00000100:00100000:0.0:1784935436.205708:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292031744 00000100:00100000:0.0:1784935436.205736:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292032256 00000100:00100000:0.0:1784935436.205739:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292032256 00000100:00100000:0.0:1784935436.205752:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292031872 00000100:00100000:0.0:1784935436.205755:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292031872 00000100:00100000:0.0:1784935436.205781:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292032384 00000100:00100000:0.0:1784935436.205784:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292032384 00000100:00100000:0.0:1784935436.205801:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784935436.205809:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292031232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.205913:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292031104:0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.205987:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935436.206015:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292031616:0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206038:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935436.206054:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292032128:0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206083:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935436.206100:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292032640:0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206119:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935436.206138:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784935436.206143:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292031488:0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206163:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935436.206174:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292032000:0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206193:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935436.206209:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292032512:0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206229:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935436.206298:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292031360 00000100:00100000:1.0:1784935436.206302:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292031360 00000100:00100000:1.0:1784935436.206323:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292031616 00000100:00100000:1.0:1784935436.206326:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292031616 00000100:00100000:1.0:1784935436.206338:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784935436.206344:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292031360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206391:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292031360:12345-0@lo:400:kworker.0 Request processed in 47us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935436.206398:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784935436.206423:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784935436.206429:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292031616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206462:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292031616:12345-0@lo:400:kworker.0 Request processed in 33us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935436.206468:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784935436.206483:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292032128 00000100:00100000:1.0:1784935436.206486:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292032128 00000100:00100000:1.0:1784935436.206503:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292032640 00000100:00100000:1.0:1784935436.206505:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292032640 00000100:00100000:1.0:1784935436.206515:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292032000 00000100:00100000:1.0:1784935436.206517:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292032000 00000100:00100000:1.0:1784935436.206528:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292032512 00000100:00100000:1.0:1784935436.206530:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292032512 00000100:00100000:1.0:1784935436.206541:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784935436.206547:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292032128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206576:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292032128:12345-0@lo:400:kworker.0 Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935436.206582:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784935436.206592:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784935436.206598:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292032640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206623:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292032640:12345-0@lo:400:kworker.0 Request processed in 25us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935436.206629:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784935436.206639:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784935436.206645:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292032000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206669:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292032000:12345-0@lo:400:kworker.0 Request processed in 25us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935436.206683:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784935436.206696:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784935436.206702:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292032512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206730:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292032512:12345-0@lo:400:kworker.0 Request processed in 29us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935436.206735:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1784935436.206768:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443433b80 x1871640292032000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935436.206780:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292032000:0@lo:400:kworker.0 00010000:00080000:1.0:1784935436.206790:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443433480 x1871640292032512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935436.206797:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292032512:0@lo:400:kworker.0 00000100:00100000:1.0:1784935436.206804:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292031616:0@lo:400:kworker.0 00010000:00080000:1.0:1784935436.206812:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443430000 x1871640292032128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935436.207080:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292032128:0@lo:400:kworker.0 00010000:00080000:1.0:1784935436.207094:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443433800 x1871640292032640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935436.207101:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292032640:0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.207224:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292031232:12345-0@lo:400:kworker.0 Request processed in 1415us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935436.207231:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784935436.207244:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292031488 00000100:00100000:0.0:1784935436.207249:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292031488 00000100:00100000:0.0:1784935436.207265:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784935436.207271:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292031744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.207300:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292031744:12345-0@lo:400:kworker.0 Request processed in 29us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935436.207306:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784935436.207318:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784935436.207325:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292032256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.207354:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292032256:12345-0@lo:400:kworker.0 Request processed in 30us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935436.207359:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784935436.207368:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784935436.207374:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292031872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.207396:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292031872:12345-0@lo:400:kworker.0 Request processed in 23us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935436.207410:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784935436.207421:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784935436.207427:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292032384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.207455:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292032384:12345-0@lo:400:kworker.0 Request processed in 28us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935436.207460:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784935436.207471:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784935436.207476:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292031488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.207508:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292031488:12345-0@lo:400:kworker.0 Request processed in 32us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935436.207514:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784935436.207554:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292032896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935436.207587:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935436.207610:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935436.207616:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292032768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935436.207649:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935436.208217:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292031104 00000100:00100000:2.0:1784935436.208224:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292031104 00000100:00100000:2.0:1784935436.208260:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784935436.208267:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292031104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.210193:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292032896 00000100:00100000:0.0:1784935436.210207:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292032896 00000100:00100000:0.0:1784935436.210246:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292032768 00000100:00100000:0.0:1784935436.210249:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292032768 00000100:00100000:0.0:1784935436.210265:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784935436.210272:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292032896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784935436.210302:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1784935436.215095:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784935436.215104:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935436.215108:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784935436.215110:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935436.218202:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292031104:12345-0@lo:400:kworker.0 Request processed in 9924us (12203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935436.218218:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784935436.221125:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292032896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10843us (13528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935436.221154:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784935436.221190:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784935436.221201:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292032768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935436.221226:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935436.221265:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292032768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (13616us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935436.221271:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784935436.221331:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292031488:0@lo:400:kworker.0 00000100:00100000:0.0:1784935436.221344:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292031104:0@lo:400:kworker.0 00010000:00080000:2.0:1784935436.221465:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434c4000 x1871640292032768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935436.221482:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292032768:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1784935436.221493:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434c4a80 x1871640292032896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935436.221503:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292032896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935436.223903:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292031360:0@lo:400:kworker.0 00010000:00080000:2.0:1784935436.226860:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443432a00 x1871640292031872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935436.226876:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292031872:0@lo:400:kworker.0 00010000:00080000:2.0:1784935436.226889:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443432680 x1871640292032384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935436.226898:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292032384:0@lo:400:kworker.0 00000100:00100000:2.0:1784935436.226909:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292031232:0@lo:400:kworker.0 00000100:00100000:2.0:1784935436.226918:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292031744:0@lo:400:kworker.0 00000100:00100000:2.0:1784935436.227000:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292032256:0@lo:400:kworker.0 00010000:00010000:2.0:1784935436.411310:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935436.723058:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292033152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935436.723134:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935436.723192:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292033024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935436.723216:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935436.723238:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292033152 00000100:00100000:2.0:1784935436.723245:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292033152 00000100:00100000:0.0:1784935436.723253:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292033024 00000100:00100000:0.0:1784935436.723255:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292033024 00000100:00100000:2.0:1784935436.723285:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784935436.723295:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292033152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784935436.723323:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935436.723369:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292033152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935436.723376:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1784935436.723521:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443601500 x1871640292033152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935436.723538:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292033152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935436.726401:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935436.726418:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292033024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784935436.726447:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935436.726546:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292033024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (3328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935436.726553:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1784935436.726606:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44429d8e00 x1871640292033024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935436.726625:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292033024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935437.229307:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292033280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935437.229383:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935437.229710:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292033280 00000100:00100000:2.0:1784935437.229718:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292033280 00000100:00100000:2.0:1784935437.229774:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784935437.229783:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292033280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784935437.229819:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784935437.229900:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292033280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935437.229909:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784935437.237398:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292033280:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784935437.423091:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935438.445395:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935439.476044:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935439.789132:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935439.789156:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292033408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935439.789222:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935439.789280:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292033408 00000100:00100000:2.0:1784935439.789287:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292033408 00000100:00100000:2.0:1784935439.789325:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784935439.789332:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292033408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784935439.789363:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784935439.789403:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292033408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935439.789409:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784935439.789448:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292033408:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784935440.494375:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784935440.780307:0:10698:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1784935441.067685:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935441.067729:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273099776 00000100:00100000:0.0:1784935441.067737:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273099776 00000100:00100000:0.0:1784935441.067790:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 271 00000100:00100000:0.0:1784935441.067799:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2392:x1871640273099776:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935441.067874:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2392:x1871640273099776:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935441.068014:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 271 00000100:00100000:3.0:1784935441.071056:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935441.071144:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273099904 00000100:00100000:0.0:1784935441.071153:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273099904 00000100:00100000:0.0:1784935441.071233:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 61 00000100:00100000:0.0:1784935441.071243:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273099904:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935441.071309:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273099904:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 68us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935441.071316:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 61 00000100:00080000:1.0:1784935441.071648:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935441.094468:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935441.094504:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935441.094574:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935441.094628:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273100032 00000100:00100000:1.0:1784935441.094637:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273100032 00000100:00100000:1.0:1784935441.094707:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 62 00000100:00100000:1.0:1784935441.094718:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273100032:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935441.094802:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273100032:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 85us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935441.094809:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 62 00000100:00080000:1.0:1784935441.094836:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784935441.096648:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273100160 00000100:00100000:2.0:1784935441.096661:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273100160 00000100:00100000:2.0:1784935441.096733:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273100288 00000100:00100000:2.0:1784935441.096737:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273100288 00000100:00100000:2.0:1784935441.096760:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:2.0:1784935441.096769:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273100160:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935441.096832:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273100160:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 64us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935441.096838:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:2.0:1784935441.096854:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:2.0:1784935441.096859:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273100288:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935441.096898:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273100288:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 38us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935441.096905:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00080000:0.0:1784935441.097923:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784935441.097951:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935441.329353:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292033920:0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.329425:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935441.329474:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292034432:0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.329499:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935441.329521:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292034944:0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.329553:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935441.329585:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1784935441.329591:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292033536:0@lo:400:kworker.0 00000100:00100000:2.0:1784935441.330065:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292033792:0@lo:400:kworker.0 00000100:00100000:2.0:1784935441.330125:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935441.330148:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292034304:0@lo:400:kworker.0 00000100:00100000:2.0:1784935441.330172:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935441.330194:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292034816:0@lo:400:kworker.0 00000100:00100000:2.0:1784935441.330216:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935441.330243:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784935441.330251:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292033664:0@lo:400:kworker.0 00000100:00100000:2.0:1784935441.330275:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935441.330310:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292034176:0@lo:400:kworker.0 00000100:00100000:2.0:1784935441.330335:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935441.330693:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292034688:0@lo:400:kworker.0 00000100:00100000:2.0:1784935441.330722:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935441.330789:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292033792 00000100:00100000:2.0:1784935441.330799:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292033792 00000100:00100000:2.0:1784935441.330869:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784935441.330879:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292033792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935441.330966:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292033792:12345-0@lo:400:kworker.0 Request processed in 89us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.331472:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935441.331507:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292034048:0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.331538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935441.331552:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292034560:0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.331574:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935441.331592:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292035072:0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.331612:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935441.331640:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292034432 00000100:00100000:3.0:1784935441.331644:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292034432 00000100:00100000:3.0:1784935441.331677:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292034944 00000100:00100000:3.0:1784935441.331680:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292034944 00000100:00100000:3.0:1784935441.331693:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292034560 00000100:00100000:3.0:1784935441.331696:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292034560 00000100:00100000:3.0:1784935441.331707:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292035072 00000100:00100000:3.0:1784935441.331710:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292035072 00000100:00100000:3.0:1784935441.331741:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784935441.331748:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292034432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.331787:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292034432:12345-0@lo:400:kworker.0 Request processed in 39us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.331794:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784935441.331812:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784935441.331818:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292034944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.331844:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292034944:12345-0@lo:400:kworker.0 Request processed in 27us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.331850:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784935441.331859:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784935441.331864:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292034560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.331887:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292034560:12345-0@lo:400:kworker.0 Request processed in 23us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.331893:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784935441.331901:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784935441.331907:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292035072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.331947:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292035072:12345-0@lo:400:kworker.0 Request processed in 41us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.331953:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784935441.331977:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292033920 00000100:00100000:3.0:1784935441.331981:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292033920 00000100:00100000:3.0:1784935441.331998:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292034304 00000100:00100000:3.0:1784935441.332000:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292034304 00000100:00100000:3.0:1784935441.332012:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292034816 00000100:00100000:3.0:1784935441.332014:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292034816 00000100:00100000:3.0:1784935441.332023:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292033664 00000100:00100000:3.0:1784935441.332032:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292033664 00000100:00100000:3.0:1784935441.332059:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292034176 00000100:00100000:3.0:1784935441.332062:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292034176 00000100:00100000:3.0:1784935441.332074:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292034688 00000100:00100000:3.0:1784935441.332077:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292034688 00000100:00100000:3.0:1784935441.332089:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784935441.332094:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292033920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.332127:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292033920:12345-0@lo:400:kworker.0 Request processed in 32us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.332133:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784935441.332144:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784935441.332149:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292034304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.332176:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292034304:12345-0@lo:400:kworker.0 Request processed in 27us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.332181:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784935441.332191:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784935441.332196:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292034816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.332221:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292034816:12345-0@lo:400:kworker.0 Request processed in 26us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.332227:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784935441.332236:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784935441.332241:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292033664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.332267:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292033664:12345-0@lo:400:kworker.0 Request processed in 26us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.332272:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784935441.332282:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784935441.332287:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292034176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.332326:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292034176:12345-0@lo:400:kworker.0 Request processed in 39us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.332331:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784935441.332342:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784935441.332347:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292034688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.332372:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292034688:12345-0@lo:400:kworker.0 Request processed in 25us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.332378:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1784935441.332417:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784935441.332422:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784935441.332425:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784935441.332427:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784935441.332455:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428ac000 x1871640292034560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935441.332468:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292034560:0@lo:400:kworker.0 00010000:00080000:3.0:1784935441.332479:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428ace00 x1871640292035072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935441.332486:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292035072:0@lo:400:kworker.0 00000100:00100000:3.0:1784935441.332497:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292033920:0@lo:400:kworker.0 00010000:00080000:3.0:1784935441.332505:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428ac380 x1871640292034432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935441.332512:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292034432:0@lo:400:kworker.0 00010000:00080000:3.0:1784935441.332522:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428aed80 x1871640292034944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935441.332542:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292034944:0@lo:400:kworker.0 00000100:00100000:1.0:1784935441.332881:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292035328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935441.332915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935441.332972:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292033664:0@lo:400:kworker.0 00000100:00100000:1.0:1784935441.332987:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292034176:0@lo:400:kworker.0 00000100:00100000:1.0:1784935441.333001:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292034688:0@lo:400:kworker.0 00000100:00100000:1.0:1784935441.333015:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292033792:0@lo:400:kworker.0 00010000:00080000:1.0:1784935441.333028:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428adc00 x1871640292034304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935441.333047:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292034304:0@lo:400:kworker.0 00010000:00080000:1.0:1784935441.333164:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428ad880 x1871640292034816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935441.333174:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292034816:0@lo:400:kworker.0 00000100:00100000:1.0:1784935441.333197:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935441.333203:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292035200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935441.333369:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935441.333412:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292035328 00000100:00100000:1.0:1784935441.333423:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292035328 00000100:00100000:1.0:1784935441.333451:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292035200 00000100:00100000:1.0:1784935441.333454:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292035200 00000100:00100000:1.0:1784935441.333473:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784935441.333480:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292035328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784935441.333506:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935441.333542:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292035328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935441.333549:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784935441.333563:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784935441.333569:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292035200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935441.333578:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935441.333601:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292035200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935441.333606:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1784935441.333628:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434c6680 x1871640292035200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935441.333641:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292035200:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1784935441.333659:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434c7480 x1871640292035328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935441.333669:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292035328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935441.333702:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292033536 00000100:00100000:1.0:1784935441.333706:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292033536 00000100:00100000:1.0:1784935441.333730:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1784935441.333736:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292033536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935441.333771:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292033536:12345-0@lo:400:kworker.0 Request processed in 36us (4153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935441.333777:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784935441.333873:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292033536:0@lo:400:kworker.0 00000100:00100000:0.0:1784935441.336477:0:6530:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1784935441.336489:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784935441.336495:0:6530:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1784935441.336526:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292034048 00000100:00100000:2.0:1784935441.336542:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292034048 00000100:00100000:0.0:1784935441.336626:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784935441.336635:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292034048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935441.336738:0:6531:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1784935441.336815:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292034048:0@lo:400:kworker.0 00000100:00100000:0.0:1784935441.338133:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292034048:12345-0@lo:400:kworker.0 Request processed in 1491us (6585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935441.338144:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:3.0:1784935441.517221:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935441.838514:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292035456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935441.838589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935441.838709:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292035456 00000100:00100000:3.0:1784935441.838717:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292035456 00000100:00100000:3.0:1784935441.838770:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784935441.838788:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292035456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784935441.838819:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935441.838869:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292035456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.838876:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1784935441.838914:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365f800 x1871640292035456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935441.838960:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292035456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935441.840077:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784935441.840092:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292035584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935441.840139:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935441.847434:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292035584 00000100:00100000:3.0:1784935441.847448:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292035584 00000100:00100000:3.0:1784935441.847517:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784935441.847526:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292035584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935441.847551:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935441.847631:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292035584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (7491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935441.847638:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1784935441.848090:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44429d8380 x1871640292035584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935441.848109:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292035584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935442.359390:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784935442.359550:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292035712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935442.359621:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935442.359734:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292035712 00000100:00100000:2.0:1784935442.359741:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292035712 00000100:00100000:2.0:1784935442.359966:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784935442.359976:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292035712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784935442.360008:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784935442.360072:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292035712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935442.360080:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784935442.360415:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292035712:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784935442.549897:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935443.578427:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935444.589495:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935444.925355:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292035840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784935444.925428:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935444.925508:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292035840 00000100:00100000:0.0:1784935444.925515:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292035840 00000100:00100000:0.0:1784935444.925556:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784935444.925565:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292035840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935444.925597:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784935444.925636:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292035840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935444.925643:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784935444.925682:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292035840:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784935445.614076:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935446.188402:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935446.188431:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935446.188454:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935446.188471:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935446.188495:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935446.188518:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273100544 00000100:00100000:1.0:1784935446.188528:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273100544 00000100:00100000:1.0:1784935446.188574:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273100672 00000100:00100000:1.0:1784935446.188577:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273100672 00000100:00100000:1.0:1784935446.188598:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 69 00000100:00100000:1.0:1784935446.188607:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273100544:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935446.188675:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273100544:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.188682:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 69 00000100:00100000:1.0:1784935446.188706:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 70 00000100:00100000:1.0:1784935446.188712:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273100672:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935446.188739:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273100672:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.188745:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 70 00000100:00100000:3.0:1784935446.189195:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273100800 00000100:00100000:3.0:1784935446.189206:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273100800 00000100:00100000:3.0:1784935446.189247:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273100928 00000100:00100000:3.0:1784935446.189250:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273100928 00000100:00100000:3.0:1784935446.189283:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 28 00000100:00100000:3.0:1784935446.189290:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273100800:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935446.189325:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273100800:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 35us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935446.189330:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 28 00000100:00100000:3.0:1784935446.189342:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 29 00000100:00100000:3.0:1784935446.189349:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273100928:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935446.189370:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273100928:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 22us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935446.189376:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 29 00000100:00080000:3.0:1784935446.189393:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784935446.189397:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784935446.189399:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784935446.189401:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935446.193456:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273100416 00000100:00100000:0.0:1784935446.193477:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273100416 00000100:00100000:0.0:1784935446.193567:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 273 00000100:00100000:0.0:1784935446.193578:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2394:x1871640273100416:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935446.193657:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2394:x1871640273100416:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 81us (5200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935446.193676:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 273 00000100:00100000:1.0:1784935446.446078:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292035968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935446.446143:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.446215:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292035968 00000100:00100000:1.0:1784935446.446222:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292035968 00000100:00100000:1.0:1784935446.446273:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784935446.446282:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292035968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784935446.446310:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935446.446351:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292035968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.446357:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1784935446.446375:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784935446.446403:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434c5880 x1871640292035968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935446.446420:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292035968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935446.450108:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292036096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935446.450177:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.450246:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292036096 00000100:00100000:1.0:1784935446.450253:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292036096 00000100:00100000:1.0:1784935446.450302:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784935446.450310:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292036096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935446.450349:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935446.450392:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292036096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.450399:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1784935446.450421:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784935446.450447:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443602300 x1871640292036096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935446.450466:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292036096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935446.457888:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292036352:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.457986:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.458033:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292036864:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458057:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.458079:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292037376:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458100:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.458126:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784935446.458131:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292036224:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458160:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.458177:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292036736:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458201:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.458218:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292037248:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458238:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.458265:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292036352 00000100:00100000:1.0:1784935446.458272:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292036352 00000100:00100000:1.0:1784935446.458309:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292036864 00000100:00100000:1.0:1784935446.458312:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292036864 00000100:00100000:1.0:1784935446.458344:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292037376 00000100:00100000:1.0:1784935446.458347:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292037376 00000100:00100000:1.0:1784935446.458363:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784935446.458371:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292036352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458419:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292036352:12345-0@lo:400:kworker.0 Request processed in 48us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.458426:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784935446.458441:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784935446.458446:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292036864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458472:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292036864:12345-0@lo:400:kworker.0 Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.458477:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784935446.458487:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784935446.458493:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292037376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458517:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292037376:12345-0@lo:400:kworker.0 Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.458523:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784935446.458543:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292036736 00000100:00100000:1.0:1784935446.458546:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292036736 00000100:00100000:1.0:1784935446.458570:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784935446.458576:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292036736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458620:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292036736:12345-0@lo:400:kworker.0 Request processed in 44us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.458626:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784935446.458642:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292037248 00000100:00100000:1.0:1784935446.458645:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292037248 00000100:00100000:1.0:1784935446.458668:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784935446.458680:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292037248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458705:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292037248:12345-0@lo:400:kworker.0 Request processed in 27us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.458710:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1784935446.458731:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935446.458734:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935446.458743:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292036480:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458763:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.458779:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292036992:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458796:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.458809:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292037504:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458827:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.458842:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784935446.458847:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292036608:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458865:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.458877:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292037120:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458896:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935446.458917:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292036480 00000100:00100000:1.0:1784935446.458921:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292036480 00000100:00100000:1.0:1784935446.458955:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784935446.458960:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292036480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.458991:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292036480:12345-0@lo:400:kworker.0 Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.458997:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784935446.459023:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292037120 00000100:00100000:1.0:1784935446.459026:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292037120 00000100:00100000:1.0:1784935446.459057:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784935446.459062:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292037120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.459090:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292037120:12345-0@lo:400:kworker.0 Request processed in 28us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.459095:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784935446.459112:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292036992 00000100:00100000:1.0:1784935446.459115:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292036992 00000100:00100000:1.0:1784935446.459133:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292037504 00000100:00100000:1.0:1784935446.459135:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292037504 00000100:00100000:1.0:1784935446.459145:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292036608 00000100:00100000:1.0:1784935446.459147:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292036608 00000100:00100000:1.0:1784935446.459156:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784935446.459161:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292036992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.459187:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292036992:12345-0@lo:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.459192:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784935446.459202:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784935446.459207:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292037504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.459228:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292037504:12345-0@lo:400:kworker.0 Request processed in 21us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.459233:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784935446.459242:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784935446.459247:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292036608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.459268:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292036608:12345-0@lo:400:kworker.0 Request processed in 21us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935446.459274:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1784935446.459289:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784935446.459296:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935446.459327:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292036608:0@lo:400:kworker.0 00010000:00080000:1.0:1784935446.459340:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443432680 x1871640292037120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935446.459349:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292037120:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.459357:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292036480:0@lo:400:kworker.0 00010000:00080000:1.0:1784935446.459364:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443433100 x1871640292036992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935446.459371:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292036992:0@lo:400:kworker.0 00010000:00080000:1.0:1784935446.459379:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443430e00 x1871640292037504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935446.459386:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292037504:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.459417:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292036736:0@lo:400:kworker.0 00010000:00080000:1.0:1784935446.459427:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443432a00 x1871640292037248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935446.459434:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292037248:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.459444:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292036352:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.459452:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292036864:0@lo:400:kworker.0 00000100:00100000:1.0:1784935446.459459:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292037376:0@lo:400:kworker.0 00000100:00100000:3.0:1784935446.459664:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292036224 00000100:00100000:3.0:1784935446.459669:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292036224 00000100:00100000:3.0:1784935446.459695:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784935446.459701:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292036224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935446.459738:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292036224:12345-0@lo:400:kworker.0 Request processed in 37us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935446.459743:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784935446.459773:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292036224:0@lo:400:kworker.0 00000001:02000400:2.0:1784935446.516517:0:10943:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing yml_node 00010000:00010000:1.0:1784935446.638617:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935446.958618:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292037632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935446.958691:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935446.958755:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292037632 00000100:00100000:3.0:1784935446.958761:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292037632 00000100:00100000:3.0:1784935446.958802:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784935446.958810:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292037632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784935446.958839:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935446.958881:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292037632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935446.958888:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1784935446.958943:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365f800 x1871640292037632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935446.961551:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292037632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935446.961603:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292037760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935446.961666:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935446.961720:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292037760 00000100:00100000:3.0:1784935446.961727:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292037760 00000100:00100000:3.0:1784935446.961768:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784935446.961777:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292037760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935446.961799:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935446.961839:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292037760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935446.961846:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1784935446.961883:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443601180 x1871640292037760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935446.961901:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292037760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935447.474518:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292037888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784935447.474595:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935447.474666:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292037888 00000100:00100000:1.0:1784935447.474673:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292037888 00000100:00100000:1.0:1784935447.474715:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784935447.474735:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292037888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784935447.474767:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784935447.474807:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292037888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935447.474813:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784935447.474854:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292037888:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784935447.662616:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935448.685073:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935449.709291:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935450.029517:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292038016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784935450.029588:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935450.029697:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292038016 00000100:00100000:2.0:1784935450.029704:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292038016 00000100:00100000:2.0:1784935450.029751:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784935450.029761:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292038016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784935450.029793:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784935450.029861:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292038016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935450.029869:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784935450.029911:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292038016:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784935450.733230:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935451.315578:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935451.315622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935451.315653:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935451.315677:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935451.315740:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273101312 00000100:00100000:1.0:1784935451.315749:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935451.315750:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273101312 00000100:00100000:1.0:1784935451.315779:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273101184 00000100:00100000:1.0:1784935451.315785:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273101184 00000100:00100000:3.0:1784935451.315819:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 77 00000100:00100000:1.0:1784935451.315828:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 78 00000100:00100000:3.0:1784935451.315833:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273101312:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935451.315899:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273101312:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 72us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935451.315906:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 77 00000100:00080000:3.0:1784935451.315947:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784935451.315959:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935451.316082:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273101440 00000100:00100000:0.0:1784935451.316087:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273101440 00000100:00100000:0.0:1784935451.316115:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273101568 00000100:00100000:0.0:1784935451.316118:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273101568 00000100:00100000:0.0:1784935451.316138:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:0.0:1784935451.316145:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2390:x1871640273101440:12345-192.168.203.28@tcp:9:kworker.0 00000020:00000080:0.0:1784935451.316171:0:8441:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1654d 00000100:00080000:0.0:1784935451.316179:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8d457e89b800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1784935451.316228:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784935451.316232:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935451.316241:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273101184:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935451.316286:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273101184:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 52us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935451.316293:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 78 00000100:00100000:1.0:1784935451.316318:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 19 00000100:00100000:1.0:1784935451.316324:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2390:x1871640273101568:12345-192.168.203.28@tcp:9:kworker.0 00000020:00000080:1.0:1784935451.316340:0:8987:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16554 00000100:00080000:1.0:1784935451.316353:0:8987:0:(import.c:65:import_set_state_nolock()) ffff8d44428f0000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784935451.321950:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273101056 00000100:00100000:2.0:1784935451.321996:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273101056 00000001:00000004:0.0:1784935451.322040:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1784935451.322047:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 275 00000100:00100000:2.0:1784935451.322056:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2391:x1871640273101056:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935451.322132:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2391:x1871640273101056:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 76us (6563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935451.322138:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 275 00000100:00100000:0.0:1784935451.322160:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+2:2390:x1871640273101440:12345-192.168.203.28@tcp:9:kworker.0 Request processed in 6014us (6481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.322168:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 18 00010000:00010000:3.0:1784935451.322226:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1784935451.322515:0:8987:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1784935451.322605:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+2:2390:x1871640273101568:12345-192.168.203.28@tcp:9:kworker.0 Request processed in 6280us (6855us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.322613:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 19 00010000:00010000:2.0:1784935451.328779:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784935451.411772:0:11127:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.207 00000100:00100000:0.0:1784935451.567193:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292038272:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.567267:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.567492:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292038784:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.567522:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.567541:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292039296:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.567564:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.567578:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292039808:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.567596:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.567619:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1784935451.567625:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292038400:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.567648:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.567665:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292038912:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.567685:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.567702:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292039424:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.567720:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.567736:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292039936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935451.567756:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.567789:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292038272 00000100:00100000:0.0:1784935451.567795:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292038272 00000100:00100000:0.0:1784935451.567842:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784935451.567850:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292038272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.567897:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292038272:12345-0@lo:400:kworker.0 Request processed in 48us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.567905:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784935451.567958:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292038784 00000100:00100000:0.0:1784935451.567962:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292038784 00000100:00100000:0.0:1784935451.568006:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784935451.568013:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292038784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.568047:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292038784:12345-0@lo:400:kworker.0 Request processed in 35us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.568054:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784935451.568072:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292039296 00000100:00100000:0.0:1784935451.568076:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292039296 00000100:00100000:0.0:1784935451.568119:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292039808 00000100:00100000:0.0:1784935451.568123:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292039808 00000100:00100000:0.0:1784935451.568139:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784935451.568144:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45743cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292039296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.568174:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45743cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292039296:12345-0@lo:400:kworker.0 Request processed in 29us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.568179:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784935451.568320:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784935451.568327:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292039808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.568355:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292039808:12345-0@lo:400:kworker.0 Request processed in 29us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.568360:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784935451.568381:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292038400 00000100:00100000:0.0:1784935451.568384:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292038400 00000100:00100000:0.0:1784935451.568405:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292038912 00000100:00100000:0.0:1784935451.568408:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292038912 00000100:00100000:0.0:1784935451.568420:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292039424 00000100:00100000:0.0:1784935451.568423:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292039424 00000100:00100000:0.0:1784935451.568450:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784935451.568457:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292038400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.568498:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292038400:12345-0@lo:400:kworker.0 Request processed in 41us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.568512:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784935451.568524:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784935451.568529:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292038912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.568556:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292038912:12345-0@lo:400:kworker.0 Request processed in 27us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.568562:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784935451.568572:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784935451.568578:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292039424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.568603:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292039424:12345-0@lo:400:kworker.0 Request processed in 26us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.568609:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784935451.568631:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292039936 00000100:00100000:0.0:1784935451.568634:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292039936 00000100:00100000:0.0:1784935451.568663:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784935451.568669:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292039936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784935451.568688:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935451.568718:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292039936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.568724:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1784935451.568744:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784935451.568749:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784935451.568751:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784935451.568790:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292038400:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.568799:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292038912:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.568807:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292039424:0@lo:400:kworker.0 00010000:00080000:0.0:1784935451.568828:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bdf80 x1871640292039936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935451.568841:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292039936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935451.568849:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292038272:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.568858:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292038784:0@lo:400:kworker.0 00010000:00080000:0.0:1784935451.568866:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bc700 x1871640292039296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935451.568873:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292039296:0@lo:400:kworker.0 00010000:00080000:0.0:1784935451.568880:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bf100 x1871640292039808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935451.568886:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292039808:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.571099:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292038144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935451.571166:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.571212:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292038656:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.571236:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.571256:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292039168:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.571277:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.571292:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292039680:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.571311:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935451.571330:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292038144 00000100:00100000:0.0:1784935451.571337:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784935451.571345:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292038528:0@lo:400:kworker.0 00000100:00100000:1.0:1784935451.571351:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292038144 00000100:00100000:0.0:1784935451.571371:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.571408:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292039040:0@lo:400:kworker.0 00000100:00100000:1.0:1784935451.571418:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784935451.571430:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292038144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784935451.571454:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935451.571500:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292038144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935451.571507:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1784935451.571529:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935451.571659:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935451.571687:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292039552:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.571709:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784935451.571738:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443431f80 x1871640292038144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935451.571757:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292038144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935451.571783:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292038528 00000100:00100000:0.0:1784935451.571787:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292038528 00000100:00100000:0.0:1784935451.571812:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784935451.571818:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292038528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.571855:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292038528:12345-0@lo:400:kworker.0 Request processed in 38us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.571861:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784935451.571880:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292038656 00000100:00100000:0.0:1784935451.571883:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292038656 00000100:00100000:0.0:1784935451.571903:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292039040 00000100:00100000:0.0:1784935451.571906:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292039040 00000100:00100000:0.0:1784935451.571921:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292039552 00000100:00100000:0.0:1784935451.571923:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292039552 00000100:00100000:0.0:1784935451.571967:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784935451.571980:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292038656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.572012:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292038656:12345-0@lo:400:kworker.0 Request processed in 32us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.572018:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784935451.572029:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784935451.572034:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292039040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.572071:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292039040:12345-0@lo:400:kworker.0 Request processed in 37us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.572078:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784935451.572090:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784935451.572095:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292039552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.572121:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292039552:12345-0@lo:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.572126:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784935451.572146:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292039168 00000100:00100000:0.0:1784935451.572149:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292039168 00000100:00100000:0.0:1784935451.572172:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292039680 00000100:00100000:0.0:1784935451.572174:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292039680 00000100:00100000:0.0:1784935451.572188:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784935451.572194:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292039168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.572222:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292039168:12345-0@lo:400:kworker.0 Request processed in 28us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.572228:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784935451.572238:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784935451.572243:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292039680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.572268:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292039680:12345-0@lo:400:kworker.0 Request processed in 25us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935451.572274:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784935451.572312:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292038528:0@lo:400:kworker.0 00010000:00080000:0.0:1784935451.572322:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443601500 x1871640292039040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935451.572330:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292039040:0@lo:400:kworker.0 00010000:00080000:0.0:1784935451.572349:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bdc00 x1871640292039552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935451.572356:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292039552:0@lo:400:kworker.0 00000100:00100000:0.0:1784935451.572365:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292038656:0@lo:400:kworker.0 00010000:00080000:0.0:1784935451.572374:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bd880 x1871640292039168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935451.572382:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292039168:0@lo:400:kworker.0 00010000:00080000:0.0:1784935451.572390:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bce00 x1871640292039680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935451.572397:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292039680:0@lo:400:kworker.0 00000100:00080000:1.0:1784935451.572639:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935451.572643:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784935451.759062:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935452.079870:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784935452.079894:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292040064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935452.079983:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935452.080045:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292040064 00000100:00100000:1.0:1784935452.080051:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292040064 00000100:00100000:1.0:1784935452.080094:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784935452.080103:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292040064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784935452.080130:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935452.080176:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292040064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935452.080183:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1784935452.080221:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443431180 x1871640292040064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935452.080239:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292040064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935452.082994:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292040192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935452.083061:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935452.083190:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292040192 00000100:00100000:3.0:1784935452.083374:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292040192 00000100:00100000:3.0:1784935452.083460:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784935452.083471:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292040192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935452.083492:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935452.083608:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292040192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935452.083616:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1784935452.083693:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bce00 x1871640292040192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935452.083711:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292040192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935452.590131:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935452.590160:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292040320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935452.590255:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935452.590413:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292040320 00000100:00100000:3.0:1784935452.590421:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292040320 00000100:00100000:3.0:1784935452.590471:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784935452.590480:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292040320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784935452.590528:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784935452.590586:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292040320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935452.590594:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784935452.590982:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292040320:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784935452.790348:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935453.815771:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784935453.992997:0:11224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.207 00010000:00010000:2.0:1784935454.837719:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935455.149045:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292040448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935455.149268:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935455.150308:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292040448 00000100:00100000:0.0:1784935455.150317:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292040448 00000100:00100000:0.0:1784935455.150364:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784935455.150375:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292040448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935455.153298:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784935455.153400:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292040448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3024us (4286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935455.153410:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784935455.155214:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292040448:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784935455.854016:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935456.442242:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935456.442277:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935456.442313:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935456.442350:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273101952 00000100:00100000:1.0:1784935456.442359:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273101952 00000100:00100000:0.0:1784935456.442370:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273101824 00000100:00100000:0.0:1784935456.442374:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273101824 00000100:00100000:1.0:1784935456.442421:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 85 00000100:00100000:1.0:1784935456.442431:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273101952:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935456.442499:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273101952:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935456.442507:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 85 00000100:00100000:3.0:1784935456.442900:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273101696 00000100:00100000:3.0:1784935456.442905:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273101696 00000100:00100000:3.0:1784935456.442961:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 277 00000100:00100000:3.0:1784935456.442969:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2392:x1871640273101696:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935456.442998:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2392:x1871640273101696:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 31us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935456.443004:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 277 00000100:00100000:2.0:1784935456.446166:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 86 00000100:00100000:2.0:1784935456.446185:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273101824:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935456.446255:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273101824:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 78us (3942us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935456.446263:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 86 00000100:00080000:0.0:1784935456.446336:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784935456.446457:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1784935456.554434:0:11321:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.207 00000100:00100000:0.0:1784935456.688742:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292040576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935456.688812:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935456.688887:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292040576 00000100:00100000:0.0:1784935456.688893:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292040576 00000100:00100000:0.0:1784935456.688976:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784935456.688986:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292040576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784935456.689014:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935456.689059:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292040576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935456.689066:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1784935456.689087:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784935456.689112:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bd880 x1871640292040576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935456.689130:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292040576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935456.692680:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292040704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935456.692750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935456.692806:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292040704 00000100:00100000:1.0:1784935456.692812:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292040704 00000100:00100000:1.0:1784935456.692860:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784935456.692870:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292040704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784935456.692892:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1784935456.695111:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784935456.695138:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292040704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2264us (2382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935456.695149:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784935456.695283:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292040832:0@lo:400:kworker.0 00000100:00100000:1.0:1784935456.695338:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935456.696161:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292041344:0@lo:400:kworker.0 00000100:00100000:1.0:1784935456.696199:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935456.696222:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292041856:0@lo:400:kworker.0 00000100:00100000:1.0:1784935456.696256:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935456.696289:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784935456.696296:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292040960:0@lo:400:kworker.0 00000100:00100000:1.0:1784935456.696319:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935456.696340:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292041472:0@lo:400:kworker.0 00000100:00100000:1.0:1784935456.696362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935456.696381:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292041984:0@lo:400:kworker.0 00000100:00100000:1.0:1784935456.696402:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935456.696445:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292041856 00000100:00100000:1.0:1784935456.696452:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292041856 00000100:00100000:2.0:1784935456.697141:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292040960 00000100:00100000:2.0:1784935456.697158:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292040960 00000100:00100000:1.0:1784935456.697178:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784935456.697189:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292041856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.697195:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292041472 00000100:00100000:2.0:1784935456.697200:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292041472 00000100:00100000:2.0:1784935456.697221:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292041984 00000100:00100000:2.0:1784935456.697224:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292041984 00000100:00100000:3.0:1784935456.697227:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292041344 00000100:00100000:3.0:1784935456.697234:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292041344 00000100:00100000:2.0:1784935456.697242:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784935456.697252:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292040960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935456.697271:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784935456.697279:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292041344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935456.697845:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292041856:12345-0@lo:400:kworker.0 Request processed in 656us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935456.697847:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292040960:12345-0@lo:400:kworker.0 Request processed in 596us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935456.697861:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784935456.697862:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784935456.697887:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784935456.697895:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292041472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935456.697898:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784935456.697910:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292041984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.697965:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292041472:12345-0@lo:400:kworker.0 Request processed in 71us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935456.697971:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784935456.697994:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292041088:0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.698028:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935456.698052:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292041600:0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.698072:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935456.698088:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292042112:0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.698108:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935456.698123:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784935456.698129:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292041216:0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.698150:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935456.698161:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292041728:0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.698184:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935456.698221:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292041088 00000100:00100000:2.0:1784935456.698226:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292041088 00000100:00100000:2.0:1784935456.698248:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784935456.698254:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292041088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.698288:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292041088:12345-0@lo:400:kworker.0 Request processed in 34us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935456.698294:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784935456.698311:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292041728 00000100:00100000:2.0:1784935456.698314:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292041728 00000100:00100000:2.0:1784935456.698344:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784935456.698352:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292041728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935456.698376:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292041984:12345-0@lo:400:kworker.0 Request processed in 467us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935456.698385:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784935456.698393:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292041728:12345-0@lo:400:kworker.0 Request processed in 41us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935456.698400:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292041600 00000100:00100000:2.0:1784935456.698401:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784935456.698406:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292041600 00000100:00100000:1.0:1784935456.698430:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292042112 00000100:00100000:1.0:1784935456.698433:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292042112 00000100:00100000:1.0:1784935456.698447:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292041216 00010000:00080000:2.0:1784935456.698450:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443433100 x1871640292040704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935456.698451:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292041216 00000100:00100000:2.0:1784935456.698473:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292040704:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1784935456.698507:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d4a80 x1871640292041728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935456.698515:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292041728:0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.698524:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292041088:0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.698542:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784935456.698548:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292041600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.698580:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292041600:12345-0@lo:400:kworker.0 Request processed in 33us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935456.698595:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784935456.698607:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784935456.698613:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292042112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.698707:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292042112:12345-0@lo:400:kworker.0 Request processed in 94us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935456.698713:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784935456.698726:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784935456.698732:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292041216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935456.698758:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292041216:12345-0@lo:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935456.698762:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784935456.698787:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292041216:0@lo:400:kworker.0 00010000:00080000:2.0:1784935456.698797:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d5880 x1871640292041600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935456.698805:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292041600:0@lo:400:kworker.0 00010000:00080000:2.0:1784935456.698815:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421de680 x1871640292042112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935456.698823:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292042112:0@lo:400:kworker.0 00000100:00080000:1.0:1784935456.699135:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784935456.699147:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935456.699151:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935456.699178:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292040960:0@lo:400:kworker.0 00000100:00100000:1.0:1784935456.699190:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292041472:0@lo:400:kworker.0 00000100:00100000:1.0:1784935456.699204:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292041984:0@lo:400:kworker.0 00010000:00080000:1.0:1784935456.699217:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d7b80 x1871640292041856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935456.699227:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292041856:0@lo:400:kworker.0 00000100:00100000:0.0:1784935456.701741:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292040832 00000100:00100000:0.0:1784935456.702842:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292040832 00000100:00100000:0.0:1784935456.703038:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1784935456.703050:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292040832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935456.703153:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292040832:12345-0@lo:400:kworker.0 Request processed in 106us (7815us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935456.703161:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1784935456.703200:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292040832:0@lo:400:kworker.0 00000100:00100000:3.0:1784935456.710793:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292041344:12345-0@lo:400:kworker.0 Request processed in 13506us (14584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935456.710807:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784935456.710864:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292041344:0@lo:400:kworker.0 00000001:00100000:3.0:1784935456.711770:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:3.0:1784935456.711775:0:9518:0:(genops.c:906:class_export_put()) final put ffff8d44428f4000/380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:2.0:1784935456.711884:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44428f4000/380c344d-145d-4a03-bcd4-797f2a6954a7 for lustre-OST0001 00000020:00000080:2.0:1784935456.712040:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d44428f0000 for lustre-OST0001 00000001:00100000:3.0:1784935456.713335:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:3.0:1784935456.713353:0:8431:0:(genops.c:906:class_export_put()) final put ffff8d457e89b000/380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:2.0:1784935456.717063:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457e89b000/380c344d-145d-4a03-bcd4-797f2a6954a7 for lustre-OST0000 00000020:00000080:2.0:1784935456.717163:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d457e89b800 for lustre-OST0000 00010000:00010000:2.0:1784935456.877205:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935457.197575:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784935457.197611:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292042240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935457.197752:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935457.197922:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292042240 00000100:00100000:0.0:1784935457.197955:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292042240 00000100:00100000:0.0:1784935457.198000:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784935457.198009:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292042240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784935457.198036:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935457.198082:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292042240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935457.198099:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1784935457.198728:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421dc700 x1871640292042240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935457.198749:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292042240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935457.198755:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935457.198766:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292042368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935457.198804:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935457.199058:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292042368 00000100:00100000:3.0:1784935457.199064:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292042368 00000100:00100000:3.0:1784935457.199103:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784935457.199111:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292042368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935457.199125:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935457.199168:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292042368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935457.199175:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1784935457.199241:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44429d8380 x1871640292042368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935457.199256:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292042368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935457.714736:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292042496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935457.714808:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935457.724480:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292042496 00000100:00100000:0.0:1784935457.724494:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292042496 00000100:00100000:0.0:1784935457.724564:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784935457.724575:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292042496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935457.724611:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935457.724913:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292042496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 339us (10103us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935457.724921:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784935457.725059:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292042496:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784935457.902060:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784935458.327510:0:11370:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jul 24 19:24:16 EDT 2026 00010000:00010000:2.0:1784935458.925508:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935459.950319:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935460.273831:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292042624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784935460.274113:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935460.274215:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292042624 00000100:00100000:0.0:1784935460.274224:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292042624 00000100:00100000:0.0:1784935460.274281:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784935460.274290:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292042624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935460.274325:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784935460.274391:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292042624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935460.274399:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784935460.274430:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292042624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784935460.974066:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935461.545294:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935461.545333:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935461.545360:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935461.545389:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273102336 00000100:00100000:1.0:1784935461.545398:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273102336 00000100:00100000:1.0:1784935461.545445:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273102208 00000100:00100000:1.0:1784935461.545448:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273102208 00000100:00100000:1.0:1784935461.545466:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 93 00000100:00100000:1.0:1784935461.545474:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273102336:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935461.545534:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273102336:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 61us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935461.545541:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 93 00000100:00100000:1.0:1784935461.545555:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 94 00000100:00100000:1.0:1784935461.545561:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2393:x1871640273102208:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935461.545603:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2393:x1871640273102208:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 42us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935461.545609:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 94 00000100:00080000:1.0:1784935461.545626:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935461.545630:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784935461.546067:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273102080 00000100:00100000:2.0:1784935461.546073:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273102080 00000100:00100000:2.0:1784935461.546116:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 279 00000100:00100000:2.0:1784935461.546124:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2394:x1871640273102080:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935461.546158:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2394:x1871640273102080:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 36us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935461.546165:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 279 00000100:00100000:3.0:1784935461.805118:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292042752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935461.805188:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935461.805285:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292042752 00000100:00100000:2.0:1784935461.805293:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292042752 00000100:00100000:2.0:1784935461.805363:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784935461.805373:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292042752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784935461.805400:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935461.805443:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292042752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935461.805449:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784935461.805477:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935461.805487:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292042880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784935461.805513:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935461.805534:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292042880 00000100:00100000:2.0:1784935461.805538:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292042880 00000100:00100000:2.0:1784935461.805557:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784935461.805575:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292042880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784935461.805586:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935461.805613:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292042880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935461.805619:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1784935461.805649:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bd500 x1871640292042880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935461.805676:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292042880:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784935461.805735:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784935461.805758:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d4380 x1871640292042752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935461.805781:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292042752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935461.806437:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292043136:0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.806551:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935461.806576:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292043648:0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.806598:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935461.806664:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292044160:0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.806687:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935461.806712:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784935461.806718:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292043264:0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.806742:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935461.806757:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292043776:0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.806776:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935461.806789:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292044288:0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.806806:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935461.806826:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292043136 00000100:00100000:3.0:1784935461.806830:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292043136 00000100:00100000:3.0:1784935461.806854:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292043648 00000100:00100000:3.0:1784935461.806856:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292043648 00000100:00100000:3.0:1784935461.806879:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292044160 00000100:00100000:3.0:1784935461.806881:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292044160 00000100:00100000:3.0:1784935461.806892:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292043776 00000100:00100000:3.0:1784935461.806895:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292043776 00000100:00100000:3.0:1784935461.806917:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292044288 00000100:00100000:3.0:1784935461.806919:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292044288 00000100:00100000:3.0:1784935461.806962:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784935461.806969:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292043136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.807089:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292043136:12345-0@lo:400:kworker.0 Request processed in 119us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935461.807096:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784935461.807111:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784935461.807117:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292043648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.807145:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292043648:12345-0@lo:400:kworker.0 Request processed in 29us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935461.807151:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784935461.807162:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784935461.807167:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292044160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.807192:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292044160:12345-0@lo:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935461.807198:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784935461.807209:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784935461.807215:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292043776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.807240:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292043776:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935461.807247:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784935461.807258:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784935461.807263:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292044288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.807289:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292044288:12345-0@lo:400:kworker.0 Request processed in 26us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935461.807295:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784935461.807319:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292043264 00000100:00100000:3.0:1784935461.807322:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292043264 00000100:00100000:3.0:1784935461.807357:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784935461.807362:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292043264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.807396:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292043264:12345-0@lo:400:kworker.0 Request processed in 33us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935461.807401:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1784935461.807423:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784935461.807427:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935461.807533:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292043264:0@lo:400:kworker.0 00010000:00080000:3.0:1784935461.807549:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365f480 x1871640292043776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935461.807559:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292043776:0@lo:400:kworker.0 00010000:00080000:3.0:1784935461.807569:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365c700 x1871640292044288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935461.807576:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292044288:0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.807585:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292043136:0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.807594:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292043648:0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.807602:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292044160:0@lo:400:kworker.0 00000100:00100000:1.0:1784935461.807709:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292043392:0@lo:400:kworker.0 00000100:00100000:1.0:1784935461.807740:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935461.807756:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292043904:0@lo:400:kworker.0 00000100:00100000:1.0:1784935461.807778:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935461.807795:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784935461.807801:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292043008:0@lo:400:kworker.0 00000100:00100000:1.0:1784935461.807826:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935461.807846:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292043520:0@lo:400:kworker.0 00000100:00100000:1.0:1784935461.807867:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935461.807883:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292044032:0@lo:400:kworker.0 00000100:00100000:1.0:1784935461.807913:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935461.807962:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292043904 00000100:00100000:1.0:1784935461.807966:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292043904 00000100:00100000:1.0:1784935461.807997:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292044032 00000100:00100000:1.0:1784935461.808000:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292044032 00000100:00100000:3.0:1784935461.808101:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292043392 00000100:00100000:3.0:1784935461.808105:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292043392 00000100:00100000:3.0:1784935461.808127:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784935461.808133:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292043392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935461.808170:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292043392:12345-0@lo:400:kworker.0 Request processed in 37us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935461.808176:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784935461.808230:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784935461.808238:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292043904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935461.808271:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292043904:12345-0@lo:400:kworker.0 Request processed in 34us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935461.808276:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784935461.808287:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784935461.808298:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292044032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935461.808324:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292044032:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935461.808329:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784935461.808346:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292043520 00000100:00100000:1.0:1784935461.808349:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292043520 00000100:00100000:1.0:1784935461.808375:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784935461.808382:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292043520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935461.808411:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292043520:12345-0@lo:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935461.808417:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784935461.808449:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292043520:0@lo:400:kworker.0 00000100:00100000:0.0:1784935461.808583:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292043008 00000100:00100000:0.0:1784935461.808588:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292043008 00000100:00100000:0.0:1784935461.808615:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1784935461.808622:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292043008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935461.808656:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292043008:12345-0@lo:400:kworker.0 Request processed in 35us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935461.808662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00010000:00080000:1.0:1784935461.808752:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365d500 x1871640292044032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935461.808763:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292044032:0@lo:400:kworker.0 00000100:00100000:1.0:1784935461.808779:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292043392:0@lo:400:kworker.0 00010000:00080000:1.0:1784935461.808788:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365df80 x1871640292043904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935461.808795:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292043904:0@lo:400:kworker.0 00000100:00100000:1.0:1784935461.808813:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292043008:0@lo:400:kworker.0 00000100:00080000:1.0:1784935461.808826:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784935461.997271:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935462.317627:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292044416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935462.317694:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935462.317950:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935462.317959:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292044544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935462.317986:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935462.318270:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292044416 00000100:00100000:2.0:1784935462.318279:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292044416 00000100:00100000:2.0:1784935462.318316:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292044544 00000100:00100000:2.0:1784935462.318319:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292044544 00000100:00100000:2.0:1784935462.318334:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784935462.318343:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292044416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784935462.318373:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935462.318427:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292044416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935462.318435:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784935462.318451:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784935462.318457:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292044544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784935462.318482:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935462.318511:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292044544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935462.318517:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1784935462.318641:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d5180 x1871640292044544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935462.318659:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292044544:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1784935462.318673:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421dc700 x1871640292044416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935462.318684:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292044416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935462.829433:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292044672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935462.829706:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935462.830066:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292044672 00000100:00100000:3.0:1784935462.830074:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292044672 00000100:00100000:3.0:1784935462.830126:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784935462.830242:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292044672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784935462.830279:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784935462.830344:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292044672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 210us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935462.830351:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784935462.831281:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292044672:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784935463.022134:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935464.045256:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935465.069623:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935465.389178:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784935465.389202:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292044800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784935465.389272:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935465.389389:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292044800 00000100:00100000:0.0:1784935465.389397:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292044800 00000100:00100000:0.0:1784935465.389732:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784935465.389741:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292044800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935465.389775:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784935465.389823:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292044800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935465.389830:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784935465.389967:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292044800:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784935466.094464:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935466.666166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935466.666215:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935466.666288:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273102592 00000100:00100000:3.0:1784935466.666310:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273102592 00000100:00100000:3.0:1784935466.666380:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 101 00000100:00100000:3.0:1784935466.666391:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273102592:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935466.666474:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273102592:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 86us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935466.666481:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 101 00000100:00100000:1.0:1784935466.666648:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935466.666832:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273102720 00000100:00100000:3.0:1784935466.666841:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273102720 00000100:00100000:3.0:1784935466.666889:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 102 00000100:00100000:3.0:1784935466.666897:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273102720:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935466.666962:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273102720:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 66us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935466.666969:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 102 00000100:00100000:2.0:1784935466.667644:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273102464 00000100:00100000:2.0:1784935466.667650:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273102464 00000100:00100000:2.0:1784935466.667736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 281 00000100:00100000:2.0:1784935466.667744:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2392:x1871640273102464:12345-192.168.203.28@tcp:400:kworker.0 00000100:00080000:0.0:1784935466.667759:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935466.667764:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935466.667792:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2392:x1871640273102464:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 49us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935466.667799:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 281 00000100:00100000:0.0:1784935466.925973:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784935466.925997:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292044928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935466.926138:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935466.926218:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292044928 00000100:00100000:0.0:1784935466.926226:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292044928 00000100:00100000:0.0:1784935466.926274:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784935466.926284:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292044928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784935466.926311:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935466.926355:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292044928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935466.926362:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1784935466.926381:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935466.926535:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292045056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935466.926564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784935466.926599:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bd880 x1871640292044928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935466.926628:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292044928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935466.926657:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292045056 00000100:00100000:0.0:1784935466.926660:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292045056 00000100:00100000:0.0:1784935466.926682:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784935466.926687:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292045056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935466.926698:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935466.926725:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292045056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935466.926731:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1784935466.926743:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784935466.926757:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bd500 x1871640292045056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935466.926769:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292045056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935466.928306:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292045568:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.928354:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935466.928380:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292046080:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.928404:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935466.928422:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784935466.928428:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292045440:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.928450:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935466.928466:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292045952:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.928484:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935466.928499:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292046464:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.928530:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935466.928762:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292045312:0@lo:400:kworker.0 00000100:00100000:1.0:1784935466.928893:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935466.928924:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292045824:0@lo:400:kworker.0 00000100:00100000:1.0:1784935466.928966:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935466.928972:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292045568 00000100:00100000:0.0:1784935466.928980:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292045568 00000100:00100000:1.0:1784935466.928986:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292046336:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.929017:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292045952 00000100:00100000:0.0:1784935466.929021:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292045952 00000100:00100000:1.0:1784935466.929028:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935466.929052:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292046464 00000100:00100000:0.0:1784935466.929056:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292046464 00000100:00100000:1.0:1784935466.929062:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784935466.929071:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292045184:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.929074:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292045312 00000100:00100000:0.0:1784935466.929078:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292045312 00000100:00100000:0.0:1784935466.929096:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292045824 00000100:00100000:0.0:1784935466.929099:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292045824 00000100:00100000:1.0:1784935466.929108:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935466.929115:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292046336 00000100:00100000:0.0:1784935466.929119:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292046336 00000100:00100000:0.0:1784935466.929143:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784935466.929145:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44410fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292045696:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.929154:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292045568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935466.929171:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935466.929196:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292046208:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.929220:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292045568:12345-0@lo:400:kworker.0 Request processed in 67us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935466.929229:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935466.929233:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784935466.929257:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784935466.929266:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292045952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935466.929268:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292046080 00000100:00100000:1.0:1784935466.929273:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292046080 00000100:00100000:0.0:1784935466.929302:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292045952:12345-0@lo:400:kworker.0 Request processed in 39us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935466.929306:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292046208 00000100:00100000:0.0:1784935466.929310:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784935466.929311:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292046208 00000100:00100000:0.0:1784935466.929329:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784935466.929338:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292046464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935466.929343:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784935466.929354:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292046080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.929379:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292046464:12345-0@lo:400:kworker.0 Request processed in 42us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935466.929387:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784935466.929399:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292046080:12345-0@lo:400:kworker.0 Request processed in 46us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935466.929408:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784935466.929414:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784935466.929425:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292045312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935466.929429:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784935466.929440:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292046208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.929473:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292045312:12345-0@lo:400:kworker.0 Request processed in 51us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935466.929482:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292046208:12345-0@lo:400:kworker.0 Request processed in 43us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935466.929483:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784935466.929497:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784935466.929501:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784935466.929513:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292045824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935466.929525:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292045184 00000100:00100000:1.0:1784935466.929530:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292045184 00000100:00100000:0.0:1784935466.929549:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292045824:12345-0@lo:400:kworker.0 Request processed in 38us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935466.929556:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784935466.929561:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1784935466.929571:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3650:x1871640292045184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.929575:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784935466.929585:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292046336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935466.929624:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3650:x1871640292045184:12345-0@lo:400:kworker.0 Request processed in 55us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935466.929633:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1784935466.929633:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292046336:12345-0@lo:400:kworker.0 Request processed in 49us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935466.929644:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1784935466.929666:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784935466.929671:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935466.929673:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292045440 00000100:00080000:0.0:1784935466.929675:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935466.929680:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292045696 00000100:00100000:1.0:1784935466.929680:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292045440 00000100:00100000:3.0:1784935466.929694:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292045696 00010000:00080000:0.0:1784935466.929710:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44410fad80 x1871640292045952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935466.929718:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784935466.929736:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292045952:0@lo:400:kworker.0 00010000:00080000:0.0:1784935466.929750:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44419ca300 x1871640292046464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935466.929760:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292046464:0@lo:400:kworker.0 00000100:00100000:1.0:1784935466.929770:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292045440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.929770:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292045568:0@lo:400:kworker.0 00010000:00080000:0.0:1784935466.929789:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44419c8000 x1871640292046080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935466.929795:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292046080:0@lo:400:kworker.0 00000100:00100000:1.0:1784935466.929831:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292045440:12345-0@lo:400:kworker.0 Request processed in 78us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935466.929836:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292045440:0@lo:400:kworker.0 00000100:00100000:3.0:1784935466.929946:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784935466.929957:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292045696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935466.930001:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292045696:12345-0@lo:400:kworker.0 Request processed in 46us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935466.930009:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784935466.932019:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292045184:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.932033:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292045696:0@lo:400:kworker.0 00010000:00080000:0.0:1784935466.932047:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44419ca680 x1871640292046208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935466.932058:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292046208:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.932072:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292045312:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.932082:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44410f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292045824:0@lo:400:kworker.0 00000100:00100000:0.0:1784935466.932092:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292046336:0@lo:400:kworker.0 00000100:00100000:1.0:1784935466.932733:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:3.0:1784935467.117203:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935467.437561:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935467.437585:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292046592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935467.437653:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935467.437718:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292046592 00000100:00100000:1.0:1784935467.437725:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292046592 00000100:00100000:1.0:1784935467.437771:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784935467.437781:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292046592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784935467.437811:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935467.437878:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292046592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935467.437886:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1784935467.437963:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443664700 x1871640292046592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935467.437981:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292046592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935467.440082:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784935467.440104:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292046720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935467.440166:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935467.440618:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292046720 00000100:00100000:2.0:1784935467.440626:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292046720 00000100:00100000:2.0:1784935467.440680:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784935467.440689:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292046720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784935467.440710:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935467.440771:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292046720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935467.440778:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1784935467.441076:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d4a80 x1871640292046720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935467.441098:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292046720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935467.950100:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935467.950124:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292046848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935467.950194:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935467.950347:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292046848 00000100:00100000:1.0:1784935467.950355:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292046848 00000100:00100000:1.0:1784935467.950403:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784935467.950411:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292046848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784935467.950446:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784935467.950491:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292046848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935467.950498:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784935467.951116:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292046848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784935468.142334:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935469.165117:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935470.194454:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935470.509891:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935470.510213:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292046976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784935470.510387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935470.510504:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292046976 00000100:00100000:2.0:1784935470.510511:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292046976 00000100:00100000:2.0:1784935470.510557:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784935470.510565:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292046976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784935470.510596:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784935470.510652:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292046976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935470.510659:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784935470.510906:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292046976:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784935471.213914:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935471.789425:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935471.789514:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935471.789548:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935471.789574:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273102848 00000100:00100000:3.0:1784935471.789598:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273102848 00000100:00100000:3.0:1784935471.789655:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 283 00000100:00100000:3.0:1784935471.789665:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2393:x1871640273102848:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935471.789738:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2393:x1871640273102848:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 74us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935471.789746:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 283 00000100:00100000:3.0:1784935471.789778:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273103104 00000100:00100000:3.0:1784935471.789782:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273103104 00000100:00100000:3.0:1784935471.790097:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273102976 00000100:00100000:3.0:1784935471.790101:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273102976 00000100:00100000:3.0:1784935471.790142:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 109 00000100:00100000:3.0:1784935471.790149:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273103104:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935471.790183:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273103104:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 34us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935471.790190:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 109 00000100:00100000:3.0:1784935471.790202:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 110 00000100:00100000:3.0:1784935471.790208:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2393:x1871640273102976:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935471.790229:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2393:x1871640273102976:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 22us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935471.790235:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 110 00000100:00080000:0.0:1784935471.790792:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784935471.790797:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935472.045106:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292047104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935472.045220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935472.046020:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292047232:0@lo:400:kworker.0 00000100:00100000:1.0:1784935472.046063:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935472.046091:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292047744:0@lo:400:kworker.0 00000100:00100000:1.0:1784935472.046131:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935472.046152:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292048256:0@lo:400:kworker.0 00000100:00100000:1.0:1784935472.046202:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935472.046224:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784935472.046230:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292047360:0@lo:400:kworker.0 00000100:00100000:1.0:1784935472.046254:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935472.046270:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292047872:0@lo:400:kworker.0 00000100:00100000:1.0:1784935472.046302:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935472.046316:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292048384:0@lo:400:kworker.0 00000100:00100000:1.0:1784935472.046335:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935472.046361:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292047744 00000100:00100000:1.0:1784935472.046368:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292047744 00000100:00100000:1.0:1784935472.046411:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784935472.046413:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292047360 00000100:00100000:3.0:1784935472.046417:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292047360 00000100:00100000:1.0:1784935472.046419:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292047744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935472.046440:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292047872 00000100:00100000:3.0:1784935472.046442:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292047872 00000100:00100000:3.0:1784935472.046463:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292048384 00000100:00100000:3.0:1784935472.046466:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292048384 00000100:00100000:1.0:1784935472.046467:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292047744:12345-0@lo:400:kworker.0 Request processed in 49us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935472.046474:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784935472.046478:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784935472.046490:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292047360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935472.046495:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292048256 00000100:00100000:1.0:1784935472.046498:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292048256 00000100:00100000:3.0:1784935472.046526:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292047360:12345-0@lo:400:kworker.0 Request processed in 37us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935472.046533:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784935472.046536:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784935472.046542:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292048256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935472.046544:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784935472.046549:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292047872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935472.046571:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292047872:12345-0@lo:400:kworker.0 Request processed in 21us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935472.046571:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292048256:12345-0@lo:400:kworker.0 Request processed in 29us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935472.046577:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784935472.046577:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784935472.046587:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784935472.046593:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292048384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935472.046617:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292048384:12345-0@lo:400:kworker.0 Request processed in 24us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935472.046618:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292047360:0@lo:400:kworker.0 00000100:00100000:3.0:1784935472.046622:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784935472.046627:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292047872:0@lo:400:kworker.0 00000100:00100000:1.0:1784935472.046636:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292048384:0@lo:400:kworker.0 00000100:00100000:1.0:1784935472.046644:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292047744:0@lo:400:kworker.0 00010000:00080000:1.0:1784935472.046655:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443664a80 x1871640292048256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935472.046665:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292048256:0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.046708:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292047104 00000100:00100000:0.0:1784935472.046713:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292047104 00000100:00100000:0.0:1784935472.046745:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784935472.046753:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292047104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935472.046773:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935472.046806:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292047104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.046812:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784935472.046828:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935472.046845:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292048768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935472.046871:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935472.046905:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292047232 00000100:00100000:0.0:1784935472.046909:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292047232 00000100:00100000:0.0:1784935472.046950:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784935472.046956:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292047232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.046981:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292047232:12345-0@lo:400:kworker.0 Request processed in 26us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.046987:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:0.0:1784935472.047006:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784935472.047009:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784935472.047011:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935472.047021:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292047488:0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.047057:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935472.047073:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292048000:0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.047089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935472.047099:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292048512:0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.047114:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935472.047135:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784935472.047140:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292047616:0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.047156:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935472.047167:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292048128:0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.047182:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935472.047194:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292048640:0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.047208:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935472.047228:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292047488 00000100:00100000:0.0:1784935472.047231:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292047488 00000100:00100000:0.0:1784935472.047249:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784935472.047254:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292047488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.047281:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292047488:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.047286:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784935472.047299:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292048128 00000100:00100000:0.0:1784935472.047302:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292048128 00000100:00100000:3.0:1784935472.047389:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292047232:0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.047658:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292048640 00000100:00100000:0.0:1784935472.047662:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292048640 00000100:00100000:0.0:1784935472.047677:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784935472.047683:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292048128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.047711:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292048128:12345-0@lo:400:kworker.0 Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.047716:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784935472.047726:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784935472.047730:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292048640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.047750:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292048640:12345-0@lo:400:kworker.0 Request processed in 20us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.047764:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784935472.047783:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292048000 00000100:00100000:0.0:1784935472.047786:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292048000 00000100:00080000:3.0:1784935472.047880:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784935472.047950:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784935472.047952:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784935472.048424:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292048512 00000100:00100000:0.0:1784935472.048430:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292048512 00000100:00100000:0.0:1784935472.048450:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292047616 00000100:00100000:0.0:1784935472.048452:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292047616 00000100:00100000:0.0:1784935472.048464:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784935472.048470:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292048000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.048592:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292048000:12345-0@lo:400:kworker.0 Request processed in 121us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.048599:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784935472.048611:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784935472.048616:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292048512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.048637:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292048512:12345-0@lo:400:kworker.0 Request processed in 22us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.048643:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784935472.048650:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784935472.048655:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292047616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.048673:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292047616:12345-0@lo:400:kworker.0 Request processed in 18us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.048678:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784935472.048710:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292047616:0@lo:400:kworker.0 00010000:00080000:0.0:1784935472.048723:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443664000 x1871640292048128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935472.048733:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292048128:0@lo:400:kworker.0 00010000:00080000:0.0:1784935472.048750:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443665c00 x1871640292048640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935472.048758:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292048640:0@lo:400:kworker.0 00000100:00100000:0.0:1784935472.048767:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292047488:0@lo:400:kworker.0 00010000:00080000:0.0:1784935472.048774:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443667b80 x1871640292048000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935472.048782:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292048000:0@lo:400:kworker.0 00010000:00080000:0.0:1784935472.048791:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443667480 x1871640292048512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935472.048799:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292048512:0@lo:400:kworker.0 00000100:00100000:1.0:1784935472.048891:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292048768 00000100:00100000:1.0:1784935472.048895:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292048768 00000100:00100000:1.0:1784935472.048918:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784935472.048924:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292048768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935472.048954:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935472.048995:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292048768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935472.049002:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1784935472.049413:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784935472.049574:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d5180 x1871640292048768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935472.049590:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292048768:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1784935472.049625:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574335880 x1871640292047104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935472.049636:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292047104:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1784935472.237270:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784935472.245511:0:11999:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:24:31 (1784935471) === 00000100:00100000:1.0:1784935472.557067:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935472.557090:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292048896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935472.557158:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935472.557590:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292048896 00000100:00100000:3.0:1784935472.557597:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292048896 00000100:00100000:3.0:1784935472.557648:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784935472.557657:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292048896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784935472.557686:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935472.557741:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292048896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935472.557761:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1784935472.558472:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443598e00 x1871640292048896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935472.558493:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292048896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935472.558907:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292049024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935472.558977:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935472.559326:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292049024 00000100:00100000:3.0:1784935472.559333:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292049024 00000100:00100000:3.0:1784935472.559374:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784935472.559384:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292049024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935472.559402:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935472.559790:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292049024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 406us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935472.559797:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1784935472.560095:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d4380 x1871640292049024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935472.560180:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292049024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935472.685766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935472.685981:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273103232 00000100:00100000:1.0:1784935472.685992:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273103232 00000100:00100000:1.0:1784935472.686040:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 285 00000100:00100000:1.0:1784935472.686051:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:8700:x1871640273103232:12345-192.168.203.28@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784935472.686068:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935472.686087:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4442a6dc00/0x857e02f4e0b16642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a84b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935472.686124:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4442a6dc00/0x857e02f4e0b16642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a84b expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935472.686135:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4442a6dc00/0x857e02f4e0b16642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a84b expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935472.686156:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6dc00, rc 0) 00000100:00100000:1.0:1784935472.686210:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8700:x1871640273103232:12345-192.168.203.28@tcp:101:mount.lustre.0 Request processed in 160us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935472.686217:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 285 00000100:00100000:3.0:1784935472.689770:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935472.690014:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273103360 00000100:00100000:0.0:1784935472.690024:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273103360 00000100:00100000:0.0:1784935472.690082:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 286 00000100:00100000:0.0:1784935472.690092:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8700:x1871640273103360:12345-192.168.203.28@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784935472.690243:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8700:x1871640273103360:12345-192.168.203.28@tcp:501:mount.lustre.0 Request processed in 152us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.690251:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 286 00000100:00100000:3.0:1784935472.692272:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935472.694918:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273103488 00000100:00100000:0.0:1784935472.694943:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273103488 00000100:00100000:0.0:1784935472.695061:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 287 00000100:00100000:0.0:1784935472.695070:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8700:x1871640273103488:12345-192.168.203.28@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784935472.695211:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8700:x1871640273103488:12345-192.168.203.28@tcp:503:mount.lustre.0 Request processed in 134us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.695219:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 287 00000100:00100000:1.0:1784935472.700656:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935472.704682:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273103616 00000100:00100000:3.0:1784935472.704697:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273103616 00000100:00100000:3.0:1784935472.704765:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 288 00000100:00100000:3.0:1784935472.704775:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8704:x1871640273103616:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784935472.704978:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8704:x1871640273103616:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 204us (4401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935472.704988:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 288 00000100:00100000:1.0:1784935472.743545:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935472.744236:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273103744 00000100:00100000:0.0:1784935472.744246:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273103744 00000100:00100000:0.0:1784935472.744331:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 289 00000100:00100000:0.0:1784935472.744341:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8704:x1871640273103744:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784935472.744497:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8704:x1871640273103744:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 157us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.744505:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 289 00000100:00100000:2.0:1784935472.750923:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935472.751043:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273103872 00000100:00100000:0.0:1784935472.751052:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273103872 00000100:00100000:0.0:1784935472.751278:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 290 00000100:00100000:0.0:1784935472.751290:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8704:x1871640273103872:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784935472.751439:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8704:x1871640273103872:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 150us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.751448:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 290 00000100:00100000:1.0:1784935472.762902:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935472.763000:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273104000 00000100:00100000:3.0:1784935472.763008:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273104000 00000100:00100000:3.0:1784935472.763055:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 291 00000100:00100000:3.0:1784935472.763064:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:8700:x1871640273104000:12345-192.168.203.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784935472.763078:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935472.763094:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541529a00/0x857e02f4e0b16649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a87c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935472.763169:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541529a00/0x857e02f4e0b16649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a87c expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935472.763180:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541529a00/0x857e02f4e0b16649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a87c expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935472.763188:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529a00, rc 0) 00000100:00100000:0.0:1784935472.763242:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:8700:x1871640273104000:12345-192.168.203.28@tcp:101:mount.lustre.0 Request processed in 180us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.763247:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 291 00000100:00100000:1.0:1784935472.766543:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935472.766628:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273104128 00000100:00100000:0.0:1784935472.766648:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273104128 00000100:00100000:0.0:1784935472.766703:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 292 00000100:00100000:0.0:1784935472.766711:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:8700:x1871640273104128:12345-192.168.203.28@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784935472.766740:0:6520:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784935472.766763:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784935472.766766:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784935472.766769:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784935472.766772:0:6520:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1784935472.766774:0:6520:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1784935472.768228:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:8700:x1871640273104128:12345-192.168.203.28@tcp:256:mount.lustre.0 Request processed in 1510us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.768241:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 292 00000100:00100000:1.0:1784935472.771217:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935472.771269:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273104256 00000100:00100000:0.0:1784935472.771291:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273104256 00000100:00100000:0.0:1784935472.771387:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 293 00000100:00100000:0.0:1784935472.771397:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:8700:x1871640273104256:12345-192.168.203.28@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784935472.771412:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935472.771433:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16650 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a883 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935472.771461:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a883 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935472.771470:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a883 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935472.771481:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540031000, rc 0) 00000100:00100000:0.0:1784935472.771536:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:8700:x1871640273104256:12345-192.168.203.28@tcp:101:mount.lustre.0 Request processed in 141us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.771544:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 293 00000100:00100000:1.0:1784935472.774153:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935472.774228:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273104384 00000100:00100000:0.0:1784935472.774237:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273104384 00000100:00100000:0.0:1784935472.774302:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 294 00000100:00100000:0.0:1784935472.774312:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:8700:x1871640273104384:12345-192.168.203.28@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784935472.774449:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:8700:x1871640273104384:12345-192.168.203.28@tcp:501:mount.lustre.0 Request processed in 138us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.774457:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 294 00000100:00100000:2.0:1784935472.776917:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935472.777119:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273104512 00000100:00100000:0.0:1784935472.777130:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273104512 00000100:00100000:0.0:1784935472.777224:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 295 00000100:00100000:0.0:1784935472.777236:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:8700:x1871640273104512:12345-192.168.203.28@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784935472.777367:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:8700:x1871640273104512:12345-192.168.203.28@tcp:503:mount.lustre.0 Request processed in 133us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.777374:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 295 00000100:00100000:1.0:1784935472.779558:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935472.779999:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273104640 00000100:00100000:2.0:1784935472.780009:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273104640 00000100:00100000:2.0:1784935472.780064:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 296 00000100:00100000:2.0:1784935472.780073:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:8709:x1871640273104640:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784935472.780224:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:8709:x1871640273104640:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 143us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935472.780232:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 296 00000100:00100000:1.0:1784935472.783555:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935472.783646:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273104768 00000100:00100000:0.0:1784935472.783655:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273104768 00000100:00100000:0.0:1784935472.783732:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 297 00000100:00100000:0.0:1784935472.783740:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:8709:x1871640273104768:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784935472.783904:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:8709:x1871640273104768:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 163us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.783912:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 297 00000100:00100000:0.0:1784935472.787335:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935472.787785:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935472.788973:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273105024 00000100:00100000:1.0:1784935472.788985:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273105024 00000100:00100000:1.0:1784935472.789041:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273105280 00000100:00100000:1.0:1784935472.789044:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273105280 00000100:00100000:1.0:1784935472.789079:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 117 00000100:00100000:1.0:1784935472.789089:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273105024:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935472.789164:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273105024:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 77us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935472.789171:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 117 00000100:00100000:1.0:1784935472.789189:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 118 00000100:00100000:1.0:1784935472.789195:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273105280:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935472.789218:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273105280:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 24us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935472.789239:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 118 00000100:00100000:1.0:1784935472.791005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935472.791058:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935472.791178:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273104896 00000100:00100000:2.0:1784935472.791187:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273104896 00000100:00100000:2.0:1784935472.791223:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273105408 00000100:00100000:2.0:1784935472.791226:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273105408 00000100:00100000:2.0:1784935472.791252:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00100000:2.0:1784935472.791260:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1871640273104896:12345-192.168.203.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784935472.791295:0:6525:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 372b228c-57a7-4786-b20d-41f2845c5abd@192.168.203.28@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:2.0:1784935472.791330:0:6525:0:(genops.c:1406:class_connect()) connect: client 372b228c-57a7-4786-b20d-41f2845c5abd, cookie 0x857e02f4e0b16657 00000004:00100000:2.0:1784935472.791353:0:6525:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784935472.791455:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8d444355f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784935472.791628:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:0.0:1784935472.791634:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1871640273105408:12345-192.168.203.28@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784935472.791651:0:6526:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 372b228c-57a7-4786-b20d-41f2845c5abd@192.168.203.28@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:0.0:1784935472.791673:0:6526:0:(genops.c:1406:class_connect()) connect: client 372b228c-57a7-4786-b20d-41f2845c5abd, cookie 0x857e02f4e0b1665e 00000004:00100000:0.0:1784935472.791685:0:6526:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1784935472.791780:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:2390:x1871640273104896:12345-192.168.203.28@tcp:38:mount.lustre.0 Request processed in 519us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935472.791788:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00080000:0.0:1784935472.792500:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8d457d2a7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784935472.792531:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+6:2390:x1871640273105408:12345-192.168.203.28@tcp:38:mount.lustre.0 Request processed in 896us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.792537:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:1.0:1784935472.794746:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935472.794783:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935472.794864:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273105152 00000100:00100000:3.0:1784935472.794873:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273105152 00000100:00100000:3.0:1784935472.794956:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273105664 00000100:00100000:3.0:1784935472.794959:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273105664 00000100:00100000:3.0:1784935472.794981:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:3.0:1784935472.794989:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+7:0:x1871640273105152:12345-192.168.203.28@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784935472.795021:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784935472.795079:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 19 00000100:00100000:2.0:1784935472.795091:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+7:8700:x1871640273105664:12345-192.168.203.28@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784935472.795108:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784935472.795134:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+7:0:x1871640273105152:12345-192.168.203.28@tcp:41:mount.lustre.0 Request processed in 145us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935472.795143:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:2.0:1784935472.795148:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+7:8700:x1871640273105664:12345-192.168.203.28@tcp:41:mount.lustre.0 Request processed in 57us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935472.795157:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 19 00000100:00080000:0.0:1784935472.795345:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935472.797416:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935472.797501:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935472.797828:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273105536 00000100:00100000:0.0:1784935472.798157:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273105536 00000100:00100000:0.0:1784935472.798224:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273105792 00000100:00100000:0.0:1784935472.798241:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273105792 00000100:00100000:0.0:1784935472.798271:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:0.0:1784935472.798280:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:0:x1871640273105536:12345-192.168.203.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784935472.798315:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00080000:1.0:1784935472.798366:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935472.798391:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:0:x1871640273105536:12345-192.168.203.28@tcp:41:mount.lustre.0 Request processed in 111us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.798399:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:0.0:1784935472.798417:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:0.0:1784935472.798424:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:8700:x1871640273105792:12345-192.168.203.28@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784935472.798453:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:8700:x1871640273105792:12345-192.168.203.28@tcp:40:mount.lustre.0 Request processed in 30us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.798459:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:1.0:1784935472.801198:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935472.801277:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935472.801309:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935472.801381:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273105920 00000100:00100000:3.0:1784935472.801390:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273105920 00000100:00100000:3.0:1784935472.801427:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273106048 00000100:00100000:3.0:1784935472.801430:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273106048 00000100:00100000:3.0:1784935472.801451:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:3.0:1784935472.801457:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1871640273105920:12345-192.168.203.28@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784935472.801500:0:8439:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 372b228c-57a7-4786-b20d-41f2845c5abd@192.168.203.28@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:3.0:1784935472.801532:0:8439:0:(genops.c:1406:class_connect()) connect: client 372b228c-57a7-4786-b20d-41f2845c5abd, cookie 0x857e02f4e0b16665 00002000:00100000:3.0:1784935472.801543:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 372b228c-57a7-4786-b20d-41f2845c5abd/ffff8d44419c3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784935472.801554:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784935472.801624:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784935472.801651:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8d44419c0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784935472.801706:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:2390:x1871640273105920:12345-192.168.203.28@tcp:8:mount.lustre.0 Request processed in 248us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935472.801714:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:3.0:1784935472.801742:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:3.0:1784935472.801747:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1871640273106048:12345-192.168.203.28@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784935472.801763:0:8439:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 372b228c-57a7-4786-b20d-41f2845c5abd@192.168.203.28@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:3.0:1784935472.801784:0:8439:0:(genops.c:1406:class_connect()) connect: client 372b228c-57a7-4786-b20d-41f2845c5abd, cookie 0x857e02f4e0b1666c 00002000:00100000:3.0:1784935472.801789:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 372b228c-57a7-4786-b20d-41f2845c5abd/ffff8d4443392000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784935472.801795:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784935472.802183:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784935472.802200:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8d4443390800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784935472.802226:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:2390:x1871640273106048:12345-192.168.203.28@tcp:8:mount.lustre.0 Request processed in 477us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935472.802233:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:0.0:1784935472.803052:0:6536:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273106176 00000100:00100000:0.0:1784935472.803059:0:6536:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273106176 00000100:00100000:0.0:1784935472.803158:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 5 00000100:00100000:0.0:1784935472.803168:0:6536:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:372b228c-57a7-4786-b20d-41f2845c5abd+6:8700:x1871640273106176:12345-192.168.203.28@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784935472.803214:0:6536:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:372b228c-57a7-4786-b20d-41f2845c5abd+6:8700:x1871640273106176:12345-192.168.203.28@tcp:900:mount.lustre.0 Request processed in 49us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935472.803221:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 5 00000100:00100000:1.0:1784935472.813223:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935472.813334:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273106304 00000100:00100000:2.0:1784935472.813352:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273106304 00000100:00100000:2.0:1784935472.813469:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 1 00000100:00100000:2.0:1784935472.813479:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:8700:x1871640273106304:12345-192.168.203.28@tcp:33:mount.lustre.0 00000004:00200000:2.0:1784935472.813604:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784935472.813681:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:8700:x1871640273106304:12345-192.168.203.28@tcp:33:mount.lustre.0 Request processed in 203us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935472.813689:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 1 00000100:00100000:0.0:1784935473.069806:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292049152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935473.069894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935473.070045:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292049152 00000100:00100000:2.0:1784935473.070053:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292049152 00000100:00100000:2.0:1784935473.070118:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784935473.070127:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292049152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784935473.070153:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784935473.070702:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292049152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 573us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935473.070710:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784935473.070890:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292049152:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784935473.261802:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935474.285135:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935475.313970:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935475.637033:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935475.637059:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292049280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935475.637126:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935475.637192:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292049280 00000100:00100000:2.0:1784935475.637199:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292049280 00000100:00100000:2.0:1784935475.637242:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784935475.637250:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292049280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784935475.637283:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784935475.637325:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292049280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935475.637332:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784935475.637378:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292049280:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784935476.333091:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935477.165977:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44431f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292049792:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166045:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166116:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292050304:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166143:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166160:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292050816:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166180:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166208:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1784935477.166214:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44431f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292049408:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166241:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166258:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292049920:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166281:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166300:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292050432:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166318:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166332:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292050944:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166351:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166376:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44431f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292049536:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166398:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166414:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292050048:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166434:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166448:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292050560:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166466:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166481:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784935477.166487:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44431f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292049664:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166507:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166524:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292050176:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166543:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166562:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292050688:0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.166581:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.166607:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292049792 00000100:00100000:0.0:1784935477.166613:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292049792 00000100:00100000:0.0:1784935477.166645:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292049536 00000100:00100000:0.0:1784935477.166647:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292049536 00000100:00100000:0.0:1784935477.166657:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292050048 00000100:00100000:3.0:1784935477.166816:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292050304 00000100:00100000:3.0:1784935477.166820:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292050304 00000100:00100000:3.0:1784935477.166846:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292050816 00000100:00100000:3.0:1784935477.166848:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292050816 00000100:00100000:3.0:1784935477.166859:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292050432 00000100:00100000:3.0:1784935477.166861:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292050432 00000100:00100000:3.0:1784935477.166872:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292050944 00000100:00100000:3.0:1784935477.166874:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292050944 00000100:00100000:3.0:1784935477.166888:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784935477.166896:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292050304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.166976:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292050304:12345-0@lo:400:kworker.0 Request processed in 80us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.166983:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784935477.166998:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784935477.167020:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292050816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167049:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292050816:12345-0@lo:400:kworker.0 Request processed in 31us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.167054:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784935477.167066:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784935477.167071:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292050432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167093:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292050432:12345-0@lo:400:kworker.0 Request processed in 22us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.167098:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784935477.167107:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784935477.167112:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292050944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167132:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292050944:12345-0@lo:400:kworker.0 Request processed in 20us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.167137:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784935477.167153:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292049408 00000100:00100000:3.0:1784935477.167156:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292049408 00000100:00100000:3.0:1784935477.167178:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1784935477.167183:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292049408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167205:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292049408:12345-0@lo:400:kworker.0 Request processed in 23us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.167210:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1784935477.167235:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292050560 00000100:00100000:3.0:1784935477.167238:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292050560 00000100:00100000:3.0:1784935477.167252:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292050176 00000100:00100000:3.0:1784935477.167255:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292050176 00000100:00100000:3.0:1784935477.167265:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292050688 00000100:00100000:3.0:1784935477.167267:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292050688 00000100:00100000:3.0:1784935477.167288:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784935477.167294:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292049792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167322:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292049792:12345-0@lo:400:kworker.0 Request processed in 29us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.167327:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784935477.167338:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784935477.167343:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292049536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167364:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292049536:12345-0@lo:400:kworker.0 Request processed in 21us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.167370:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784935477.167379:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784935477.167385:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292050560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167406:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292050560:12345-0@lo:400:kworker.0 Request processed in 22us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.167410:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784935477.167420:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784935477.167425:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292050176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167448:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292050176:12345-0@lo:400:kworker.0 Request processed in 23us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.167453:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784935477.167463:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784935477.167469:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292050688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167491:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292050688:12345-0@lo:400:kworker.0 Request processed in 24us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.167495:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784935477.167528:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44431f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292049408:0@lo:400:kworker.0 00010000:00080000:3.0:1784935477.167543:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44423cf100 x1871640292050432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935477.167554:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292050432:0@lo:400:kworker.0 00010000:00080000:3.0:1784935477.167564:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443601500 x1871640292050944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935477.167572:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292050944:0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167582:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44431f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292049792:0@lo:400:kworker.0 00010000:00080000:3.0:1784935477.167591:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44423cce00 x1871640292050304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935477.167599:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292050304:0@lo:400:kworker.0 00010000:00080000:3.0:1784935477.167607:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443602680 x1871640292050816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935477.167612:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292050816:0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167638:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784935477.167644:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292051072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935477.167676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784935477.167702:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44423ce300 x1871640292050176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935477.167708:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292050176:0@lo:400:kworker.0 00010000:00080000:3.0:1784935477.167713:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb6300 x1871640292050688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935477.167727:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292050688:0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167734:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44431f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292049536:0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167740:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292050560:0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167771:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292049920 00000100:00100000:3.0:1784935477.167775:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292049920 00000100:00100000:3.0:1784935477.167797:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292049664 00000100:00100000:3.0:1784935477.167810:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292049664 00000100:00100000:3.0:1784935477.167824:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784935477.167830:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292049920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167864:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292049920:12345-0@lo:400:kworker.0 Request processed in 34us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.167870:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784935477.167881:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784935477.167886:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292049664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167916:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292049664:12345-0@lo:400:kworker.0 Request processed in 29us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.167921:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784935477.167954:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292049920:0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167967:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44431f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292049664:0@lo:400:kworker.0 00000100:00100000:3.0:1784935477.167981:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292051072 00000100:00100000:3.0:1784935477.167983:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292051072 00000100:00100000:3.0:1784935477.167999:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784935477.168003:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292051072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784935477.168025:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935477.168050:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292051072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.168054:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1784935477.168072:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428ac380 x1871640292051072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935477.168082:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292051072:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1784935477.168224:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784935477.168228:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935477.168230:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784935477.168232:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935477.169274:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935477.169290:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292051200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935477.169338:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935477.169377:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292051200 00000100:00100000:2.0:1784935477.169384:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292051200 00000100:00100000:2.0:1784935477.169426:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784935477.169434:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292051200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784935477.169452:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935477.169489:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292051200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935477.169495:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1784935477.169556:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443431180 x1871640292051200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935477.169570:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292051200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935477.169645:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292050048 00000100:00100000:0.0:1784935477.169696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784935477.169703:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292050048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935477.169749:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292050048:12345-0@lo:400:kworker.0 Request processed in 46us (3313us total) trans 0 rc 0/0 00000100:00080000:1.0:1784935477.169750:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935477.169755:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784935477.169867:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292050048:0@lo:400:kworker.0 00010000:00010000:3.0:1784935477.357149:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935477.679792:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292051328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935477.679883:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935477.684372:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292051328 00000100:00100000:0.0:1784935477.684388:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292051328 00000100:00100000:0.0:1784935477.684451:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784935477.684461:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292051328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784935477.684508:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935477.684593:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292051328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (4710us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935477.684601:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1784935477.685114:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443433480 x1871640292051328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935477.685135:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292051328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935477.687711:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784935477.687734:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292051456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935477.687828:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935477.691399:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292051456 00000100:00100000:1.0:1784935477.691411:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292051456 00000100:00100000:1.0:1784935477.691458:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784935477.691467:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292051456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784935477.691501:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935477.691598:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292051456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (3769us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935477.691605:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1784935477.692115:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434c6300 x1871640292051456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935477.692137:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292051456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935477.930546:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935477.930589:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935477.930627:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935477.930661:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935477.930681:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273106560 00000100:00100000:3.0:1784935477.930685:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273107072 00000100:00100000:1.0:1784935477.930692:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935477.930696:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273107072 00000100:00100000:0.0:1784935477.930696:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273106560 00000100:00100000:1.0:1784935477.930727:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935477.930749:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273106816 00000100:00100000:2.0:1784935477.930754:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273106816 00000100:00100000:0.0:1784935477.930758:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273106688 00000100:00100000:0.0:1784935477.930764:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273106688 00000100:00100000:1.0:1784935477.930765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935477.930794:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273106944 00000100:00100000:1.0:1784935477.930815:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273106944 00000100:00100000:0.0:1784935477.930823:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 125 00000100:00100000:3.0:1784935477.930825:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273107200 00000100:00100000:3.0:1784935477.930831:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273107200 00000100:00100000:0.0:1784935477.930836:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2393:x1871640273106560:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935477.930851:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 126 00000100:00100000:1.0:1784935477.930862:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273106688:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935477.930867:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 49 00000100:00100000:3.0:1784935477.930878:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:2393:x1871640273107072:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935477.930919:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273106688:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 57us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935477.930920:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2393:x1871640273106560:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 85us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.930953:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:2393:x1871640273107072:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 47us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.930965:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 49 00000100:00100000:0.0:1784935477.930974:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 125 00000100:00100000:3.0:1784935477.930996:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:3.0:1784935477.931005:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:2393:x1871640273107200:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935477.931028:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+6:2393:x1871640273107200:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935477.931035:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:1.0:1784935477.931300:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 126 00000100:00100000:1.0:1784935477.931322:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 127 00000100:00100000:1.0:1784935477.931337:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+6:2393:x1871640273106944:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935477.931369:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+6:2393:x1871640273106944:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 35us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935477.931376:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 127 00000100:00100000:2.0:1784935477.931690:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 128 00000100:00100000:2.0:1784935477.931699:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+6:2393:x1871640273106816:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935477.931730:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+6:2393:x1871640273106816:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 34us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935477.931736:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 128 00000100:00100000:0.0:1784935477.931908:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273106432 00000100:00100000:0.0:1784935477.931915:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273106432 00000100:00100000:0.0:1784935477.932419:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 299 00000100:00100000:0.0:1784935477.932428:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2393:x1871640273106432:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935477.932545:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2393:x1871640273106432:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 117us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935477.932552:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 299 00000100:00080000:0.0:1784935477.932592:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784935477.932598:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935477.932600:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784935477.932603:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935478.191114:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784935478.191140:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292051584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935478.191209:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935478.191277:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292051584 00000100:00100000:0.0:1784935478.191284:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292051584 00000100:00100000:0.0:1784935478.191327:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784935478.191337:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292051584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935478.191372:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935478.191417:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292051584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935478.191424:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784935478.191468:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292051584:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1784935478.194330:0:12191:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1784935478.397009:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784935478.706004:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 372b228c-57a7-4786-b20d-41f2845c5abd 00000001:00100000:2.0:1784935478.706588:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 372b228c-57a7-4786-b20d-41f2845c5abd 00000001:00100000:3.0:1784935478.707202:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 372b228c-57a7-4786-b20d-41f2845c5abd 00000001:00100000:1.0:1784935478.708854:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 372b228c-57a7-4786-b20d-41f2845c5abd 00010000:00010000:2.0:1784935479.416346:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935480.445889:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935480.749832:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784935480.749858:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292051712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935480.749924:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935480.750009:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292051712 00000100:00100000:2.0:1784935480.750026:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292051712 00000100:00100000:2.0:1784935480.750071:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784935480.750078:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292051712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784935480.750110:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784935480.750152:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292051712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935480.750159:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784935480.750203:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292051712:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784935481.454949:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935482.285389:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292051840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935482.286046:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935482.286316:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292051840 00000100:00100000:0.0:1784935482.286324:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292051840 00000100:00100000:0.0:1784935482.286397:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784935482.286406:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292051840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935482.286433:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935482.286475:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292051840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935482.286480:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1784935482.286792:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784935482.286833:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443433100 x1871640292051840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935482.286864:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292051840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935482.287580:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784935482.287604:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292051968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935482.287646:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935482.287880:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292051968 00000100:00100000:1.0:1784935482.287887:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292051968 00000100:00100000:1.0:1784935482.287960:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784935482.287969:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292051968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935482.287986:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935482.288024:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292051968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935482.288031:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1784935482.288190:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784935482.288226:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443665c00 x1871640292051968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935482.288242:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292051968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935482.291691:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292052096:0@lo:400:kworker.0 00000100:00100000:0.0:1784935482.291776:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935482.291882:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292052096 00000100:00100000:3.0:1784935482.291889:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292052096 00000100:00100000:3.0:1784935482.291964:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1784935482.291973:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292052096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935482.292453:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292052224:0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.294819:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292052096:12345-0@lo:400:kworker.0 Request processed in 2837us (3041us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935482.294835:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1784935482.294923:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292052352:0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.294993:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935482.295030:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292052864:0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.295054:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935482.295080:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292053376:0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.295100:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935482.295139:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784935482.295146:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292052480:0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.295167:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935482.295185:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292052992:0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.295216:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935482.295252:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292052864 00000100:00100000:3.0:1784935482.295260:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292052864 00000100:00100000:3.0:1784935482.295299:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292053376 00000100:00100000:3.0:1784935482.295303:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292053376 00000100:00100000:3.0:1784935482.295326:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292052480 00000100:00100000:3.0:1784935482.295328:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292052480 00000100:00100000:3.0:1784935482.295341:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784935482.295348:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292052864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.295407:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292052864:12345-0@lo:400:kworker.0 Request processed in 60us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935482.295415:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784935482.295437:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1784935482.295443:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292053376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.295470:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292053376:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935482.295476:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1784935482.295486:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784935482.295491:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292052480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.295515:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292052480:12345-0@lo:400:kworker.0 Request processed in 24us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935482.295521:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784935482.295543:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292052992 00000100:00100000:3.0:1784935482.295546:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292052992 00000100:00100000:3.0:1784935482.295569:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784935482.295575:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292052992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.295617:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292052992:12345-0@lo:400:kworker.0 Request processed in 41us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935482.295623:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1784935482.295643:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784935482.295647:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935482.295678:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292052480:0@lo:400:kworker.0 00010000:00080000:3.0:1784935482.295691:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442955f80 x1871640292052992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935482.295712:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292052992:0@lo:400:kworker.0 00010000:00080000:3.0:1784935482.295725:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442957100 x1871640292052864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935482.295732:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292052864:0@lo:400:kworker.0 00010000:00080000:3.0:1784935482.295741:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442955180 x1871640292053376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935482.295749:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292053376:0@lo:400:kworker.0 00000100:00100000:2.0:1784935482.297773:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292052352 00000100:00100000:2.0:1784935482.297794:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292052352 00000100:00100000:2.0:1784935482.297874:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784935482.297884:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292052352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935482.298008:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292052352:12345-0@lo:400:kworker.0 Request processed in 126us (3015us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935482.298016:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784935482.299469:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292052352:0@lo:400:kworker.0 00000100:00100000:0.0:1784935482.300540:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292052096:0@lo:400:kworker.0 00000100:00100000:0.0:1784935482.300571:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292052608:0@lo:400:kworker.0 00000100:00100000:0.0:1784935482.300626:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935482.300700:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292053120:0@lo:400:kworker.0 00000100:00100000:0.0:1784935482.300722:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935482.301050:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292053120 00000100:00100000:3.0:1784935482.301057:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292053120 00000100:00100000:3.0:1784935482.301114:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784935482.301122:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292053120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.301174:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292053120:12345-0@lo:400:kworker.0 Request processed in 53us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935482.301181:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1784935482.301199:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784935482.301438:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442956300 x1871640292053120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935482.301450:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292053120:0@lo:400:kworker.0 00000100:00100000:1.0:1784935482.301809:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935482.301839:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292052736:0@lo:400:kworker.0 00000100:00100000:1.0:1784935482.301873:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935482.301895:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292053248:0@lo:400:kworker.0 00000100:00100000:1.0:1784935482.301914:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935482.302508:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292052608 00000100:00100000:2.0:1784935482.302517:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292052608 00000100:00100000:2.0:1784935482.302602:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784935482.302610:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292052608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935482.302666:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292052608:12345-0@lo:400:kworker.0 Request processed in 57us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935482.302673:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784935482.302740:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292052224 00000100:00100000:3.0:1784935482.302744:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292052224 00000100:00100000:3.0:1784935482.302791:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292052736 00000100:00100000:3.0:1784935482.302794:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292052736 00000100:00100000:3.0:1784935482.302815:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292053248 00000100:00100000:3.0:1784935482.302817:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292053248 00000100:00100000:3.0:1784935482.302830:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784935482.302835:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292052224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.302896:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292052224:12345-0@lo:400:kworker.0 Request processed in 61us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935482.302903:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784935482.302915:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784935482.302944:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292052736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.302972:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292052736:12345-0@lo:400:kworker.0 Request processed in 52us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935482.302978:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784935482.302989:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784935482.302995:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292053248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935482.303019:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292053248:12345-0@lo:400:kworker.0 Request processed in 25us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935482.303025:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1784935482.303043:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935482.304288:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292052608:0@lo:400:kworker.0 00000100:00100000:1.0:1784935482.305824:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292052224:0@lo:400:kworker.0 00000100:00100000:1.0:1784935482.305841:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292052736:0@lo:400:kworker.0 00000100:00100000:1.0:1784935482.305852:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292053248:0@lo:400:kworker.0 00010000:00010000:1.0:1784935482.477108:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935482.804056:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935482.804080:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292053504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935482.804145:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935482.804208:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292053504 00000100:00100000:2.0:1784935482.804216:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292053504 00000100:00100000:2.0:1784935482.804261:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784935482.804269:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292053504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784935482.804297:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935482.804337:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292053504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935482.804344:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1784935482.804382:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442956a00 x1871640292053504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935482.804400:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292053504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935482.808946:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935482.808967:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292053632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935482.809040:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935482.809232:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292053632 00000100:00100000:1.0:1784935482.809239:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292053632 00000100:00100000:1.0:1784935482.809288:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784935482.809297:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292053632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784935482.809318:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935482.809378:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292053632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935482.809385:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1784935482.809456:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443664a80 x1871640292053632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935482.809474:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292053632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935483.049177:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935483.049218:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935483.049243:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935483.049268:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935483.049289:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935483.049307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935483.049310:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273107456 00000100:00100000:0.0:1784935483.049320:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273107456 00000100:00100000:3.0:1784935483.049329:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935483.049347:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273107712 00000100:00100000:3.0:1784935483.049350:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273107712 00000100:00100000:3.0:1784935483.049366:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273107840 00000100:00100000:0.0:1784935483.049366:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273107584 00000100:00100000:3.0:1784935483.049368:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273107840 00000100:00100000:0.0:1784935483.049368:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273107584 00000100:00100000:3.0:1784935483.049382:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 135 00000100:00100000:3.0:1784935483.049390:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273107456:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935483.049395:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 136 00000100:00100000:0.0:1784935483.049400:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273107712:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935483.049459:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273107456:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 69us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935483.049471:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 135 00000100:00100000:3.0:1784935483.049488:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 137 00000100:00100000:3.0:1784935483.049494:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273107840:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935483.051179:0:7797:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1784935483.051193:0:7797:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1784935483.051513:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 138 00000100:00100000:2.0:1784935483.051528:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273107584:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935483.057259:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273107712:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 7847us (8030us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935483.057273:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 136 00000100:00100000:3.0:1784935483.062600:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273107840:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 13094us (13279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935483.062615:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 137 00000100:00100000:2.0:1784935483.064039:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273107584:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 12506us (14738us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935483.064052:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 138 00000100:00100000:3.0:1784935483.066146:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273107968 00000100:00100000:3.0:1784935483.066159:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273107968 00000100:00100000:3.0:1784935483.066209:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273108096 00000100:00100000:3.0:1784935483.066212:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273108096 00000100:00100000:3.0:1784935483.066241:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:3.0:1784935483.066249:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273107968:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935483.066314:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273107968:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 65us (17070us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935483.066321:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:3.0:1784935483.066336:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 54 00000100:00100000:3.0:1784935483.066342:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273108096:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935483.066362:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273108096:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 21us (17032us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935483.066367:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 54 00000100:00100000:3.0:1784935483.066385:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273107328 00000100:00100000:3.0:1784935483.066388:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273107328 00000100:00100000:3.0:1784935483.066442:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 301 00000100:00100000:3.0:1784935483.066448:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2391:x1871640273107328:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935483.066474:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2391:x1871640273107328:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 27us (17206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935483.066479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 301 00000100:00080000:3.0:1784935483.066512:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784935483.066516:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784935483.066518:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784935483.066521:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935483.309338:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292053760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935483.309428:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935483.310240:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292053760 00000100:00100000:0.0:1784935483.310251:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292053760 00000100:00100000:0.0:1784935483.310306:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784935483.310315:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292053760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935483.310365:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935483.310498:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292053760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 183us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935483.310505:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784935483.310667:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292053760:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784935483.508436:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935484.533486:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935485.551279:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935485.869961:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292053888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784935485.870031:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935485.870181:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292053888 00000100:00100000:1.0:1784935485.870188:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292053888 00000100:00100000:1.0:1784935485.870227:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784935485.870236:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292053888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784935485.870268:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784935485.870313:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292053888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935485.870320:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784935485.870363:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292053888:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1784935485.965837:0:12509:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784935485.966328:0:12509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784935486.580820:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935487.405093:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784935487.405275:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292054144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935487.405342:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935487.405413:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292054016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935487.405445:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935487.405553:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935487.405562:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292054656:0@lo:400:kworker.0 00000100:00100000:2.0:1784935487.405592:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935487.405610:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292054528:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.405621:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292054400:0@lo:400:kworker.0 00000100:00100000:2.0:1784935487.405636:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935487.405642:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935487.405655:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292054912:0@lo:400:kworker.0 00000100:00100000:2.0:1784935487.405655:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292055168:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.405673:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935487.405674:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935487.405691:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292055424:0@lo:400:kworker.0 00000100:00100000:2.0:1784935487.405691:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784935487.405709:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292055040:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.405719:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935487.405745:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292054528 00000100:00100000:2.0:1784935487.405753:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292054528 00000100:00100000:3.0:1784935487.405758:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784935487.405763:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292054272:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.405787:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935487.405804:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292054784:0@lo:400:kworker.0 00000100:00100000:2.0:1784935487.405805:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784935487.405823:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e144450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292054528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.405867:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935487.405869:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e144450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292054528:12345-0@lo:400:kworker.0 Request processed in 57us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935487.405883:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292055296:0@lo:400:kworker.0 00000100:00100000:2.0:1784935487.405884:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784935487.405902:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935487.405925:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292054656 00000100:00100000:3.0:1784935487.405944:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292054656 00000100:00100000:3.0:1784935487.405968:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292054400 00000100:00100000:3.0:1784935487.405971:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292054400 00000100:00100000:3.0:1784935487.405979:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292054912 00000100:00100000:3.0:1784935487.405982:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292054912 00000100:00100000:3.0:1784935487.405997:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292055424 00000100:00100000:3.0:1784935487.405999:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292055424 00000100:00100000:3.0:1784935487.406010:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784935487.406015:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292054656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.406042:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292054656:12345-0@lo:400:kworker.0 Request processed in 27us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935487.406047:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784935487.406057:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784935487.406062:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292054400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.406085:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292054400:12345-0@lo:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935487.406091:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784935487.406099:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784935487.406104:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292054912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.406123:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292054912:12345-0@lo:400:kworker.0 Request processed in 20us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935487.406128:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784935487.406136:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784935487.406146:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292055424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935487.406164:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292054784 00000100:00100000:2.0:1784935487.406167:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292054784 00000100:00100000:3.0:1784935487.406169:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292055424:12345-0@lo:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935487.406175:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784935487.406182:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784935487.406187:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292054784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.406190:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292055168 00000100:00100000:3.0:1784935487.406193:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292055168 00000100:00100000:2.0:1784935487.406215:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292054784:12345-0@lo:400:kworker.0 Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935487.406221:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784935487.406225:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292055296 00000100:00100000:3.0:1784935487.406227:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292055296 00000100:00100000:2.0:1784935487.406239:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935487.406245:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784935487.406250:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292055168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935487.406252:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292055552:0@lo:400:kworker.0 00000100:00100000:2.0:1784935487.406273:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935487.406276:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292055168:12345-0@lo:400:kworker.0 Request processed in 27us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935487.406282:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784935487.406291:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1784935487.406294:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443591880 x1871640292055168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935487.406296:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292055296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935487.406308:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292055168:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.406318:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292055296:12345-0@lo:400:kworker.0 Request processed in 22us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935487.406318:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292054656:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.406323:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784935487.406325:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292054528:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.406337:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292055040 00000100:00100000:3.0:1784935487.406340:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292055040 00000100:00100000:2.0:1784935487.406343:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292055552 00000100:00100000:2.0:1784935487.406345:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292055552 00000100:00100000:3.0:1784935487.406356:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784935487.406360:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292055040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.406390:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292055040:12345-0@lo:400:kworker.0 Request processed in 29us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935487.407089:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784935487.407100:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292055552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935487.407135:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292055552:12345-0@lo:400:kworker.0 Request processed in 39us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935487.407140:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00080000:2.0:1784935487.407167:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443590380 x1871640292055040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935487.407185:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292055040:0@lo:400:kworker.0 00010000:00080000:2.0:1784935487.407195:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443591c00 x1871640292055552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935487.407203:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292055552:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.409552:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784935487.409612:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292054272 00000100:00100000:3.0:1784935487.409621:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292054272 00000100:00100000:3.0:1784935487.409688:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784935487.409697:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292054272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.411562:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292054272:12345-0@lo:400:kworker.0 Request processed in 1858us (5765us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935487.411575:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:3.0:1784935487.411626:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784935487.411631:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784935487.411634:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935487.411687:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292054272:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.411704:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292054784:0@lo:400:kworker.0 00010000:00080000:3.0:1784935487.411722:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443590700 x1871640292055296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935487.411742:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292055296:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.411755:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292054400:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.411765:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292054912:0@lo:400:kworker.0 00000100:00100000:3.0:1784935487.411775:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292055424:0@lo:400:kworker.0 00000100:00100000:1.0:1784935487.416710:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292054144 00000100:00100000:1.0:1784935487.416724:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292054144 00000100:00080000:1.0:1784935487.416802:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935487.416817:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292054016 00000100:00100000:3.0:1784935487.416821:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292054016 00000100:00100000:3.0:1784935487.416862:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784935487.416871:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292054144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784935487.416903:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935487.416997:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292054144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (11655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935487.417004:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1784935487.417057:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443665180 x1871640292054144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935487.417078:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292054144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935487.417106:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784935487.417112:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292054016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784935487.417122:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935487.417152:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292054016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (11706us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935487.417158:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1784935487.417180:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365c000 x1871640292054016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935487.417193:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292054016:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784935487.417662:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784935487.598626:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935487.917225:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292055680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935487.917292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935487.917488:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292055680 00000100:00100000:2.0:1784935487.917495:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292055680 00000100:00100000:2.0:1784935487.917547:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784935487.917557:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292055680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784935487.917585:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935487.917631:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292055680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935487.917638:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1784935487.917678:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442955500 x1871640292055680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935487.917696:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292055680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935487.918146:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292055808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935487.918176:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935487.920518:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292055808 00000100:00100000:2.0:1784935487.920531:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292055808 00000100:00100000:2.0:1784935487.920592:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784935487.920602:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292055808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784935487.920626:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935487.920711:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292055808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935487.920717:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1784935487.920982:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443666a00 x1871640292055808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935487.921001:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292055808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935488.169406:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935488.169449:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935488.169486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935488.169511:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935488.169531:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935488.169557:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273108864 00000100:00100000:1.0:1784935488.169578:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273108864 00000100:00100000:1.0:1784935488.169636:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 57 00000100:00100000:1.0:1784935488.169645:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273108864:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935488.169711:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273108864:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935488.169719:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 57 00000100:00100000:1.0:1784935488.169752:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273108224 00000100:00100000:1.0:1784935488.169755:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273108224 00000100:00100000:1.0:1784935488.169782:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 303 00000100:00100000:1.0:1784935488.169794:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2392:x1871640273108224:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935488.169819:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2392:x1871640273108224:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 31us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935488.169826:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 303 00000100:00080000:1.0:1784935488.169850:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784935488.170038:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273108352 00000100:00100000:0.0:1784935488.170043:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273108352 00000100:00100000:0.0:1784935488.170088:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273108608 00000100:00100000:0.0:1784935488.170091:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273108608 00000100:00100000:0.0:1784935488.170116:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273108480 00000100:00100000:0.0:1784935488.170119:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273108480 00000100:00100000:0.0:1784935488.170135:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 145 00000100:00100000:0.0:1784935488.170142:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273108352:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935488.170176:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273108352:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 34us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935488.170182:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 145 00000100:00100000:0.0:1784935488.170195:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 146 00000100:00100000:0.0:1784935488.170201:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273108608:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935488.170230:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273108608:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 28us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935488.170236:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 146 00000100:00100000:0.0:1784935488.170247:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 147 00000100:00100000:0.0:1784935488.170253:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273108480:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935488.170274:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273108480:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 22us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935488.170280:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 147 00000100:00100000:3.0:1784935488.171351:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935488.171403:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935488.171476:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273108992 00000100:00100000:3.0:1784935488.171482:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273108992 00000100:00100000:3.0:1784935488.171520:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 58 00000100:00100000:3.0:1784935488.171528:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273108992:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935488.171566:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273108992:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 39us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935488.171573:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 58 00000100:00080000:1.0:1784935488.171923:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784935488.171947:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784935488.171949:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935488.172411:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273108736 00000100:00100000:0.0:1784935488.172417:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273108736 00000100:00100000:0.0:1784935488.172461:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 148 00000100:00100000:0.0:1784935488.172470:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273108736:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935488.172512:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273108736:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 43us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935488.172519:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 148 00000100:00080000:3.0:1784935488.172682:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935488.435715:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784935488.435752:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292055936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935488.435850:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935488.435908:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292055936 00000100:00100000:0.0:1784935488.435915:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292055936 00000100:00100000:0.0:1784935488.435972:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784935488.435979:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292055936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935488.436025:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935488.436068:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292055936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935488.436076:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784935488.436116:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292055936:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1784935488.620362:0:12606:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784935488.621560:0:12606:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784935488.622198:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935489.645403:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935490.671771:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784935490.764829:0:12703:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784935490.765307:0:12703:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784935490.989408:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292056064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784935490.989476:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935490.989859:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292056064 00000100:00100000:1.0:1784935490.989867:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292056064 00000100:00100000:1.0:1784935490.989917:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784935490.989941:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292056064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784935490.989983:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784935490.990027:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292056064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935490.990034:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784935490.990160:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292056064:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784935491.693812:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935492.525119:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292056192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935492.525244:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935492.525665:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292056192 00000100:00100000:2.0:1784935492.525673:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292056192 00000100:00100000:2.0:1784935492.525735:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784935492.525746:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292056192:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935492.525853:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292056576:0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.525906:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935492.525924:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292057088:0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.525964:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935492.525978:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292057600:0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.525996:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935492.526016:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784935492.526022:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292056704:0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526060:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935492.526079:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292057216:0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526098:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935492.526114:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292057728:0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526133:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935492.526159:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292056704 00000100:00100000:1.0:1784935492.526163:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292056704 00000100:00100000:1.0:1784935492.526189:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784935492.526195:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292056704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526243:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292056704:12345-0@lo:400:kworker.0 Request processed in 48us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935492.526250:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784935492.526271:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292056576 00000100:00100000:1.0:1784935492.526274:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292056576 00000100:00100000:1.0:1784935492.526311:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292057088 00000100:00100000:1.0:1784935492.526314:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292057088 00000100:00100000:1.0:1784935492.526326:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292057600 00000100:00100000:1.0:1784935492.526328:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292057600 00000100:00100000:1.0:1784935492.526339:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292057216 00000100:00100000:1.0:1784935492.526349:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292057216 00000100:00100000:1.0:1784935492.526367:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292057728 00000100:00100000:1.0:1784935492.526369:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292057728 00000100:00100000:1.0:1784935492.526382:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784935492.526387:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292056576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526418:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292056576:12345-0@lo:400:kworker.0 Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935492.526424:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784935492.526436:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784935492.526442:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292057088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526471:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292057088:12345-0@lo:400:kworker.0 Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935492.526478:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784935492.526488:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784935492.526493:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292057600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526517:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292057600:12345-0@lo:400:kworker.0 Request processed in 24us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935492.526523:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784935492.526534:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784935492.526540:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292057216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526566:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292057216:12345-0@lo:400:kworker.0 Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935492.526572:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784935492.526582:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784935492.526587:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292057728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526612:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292057728:12345-0@lo:400:kworker.0 Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935492.526622:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784935492.526663:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292056704:0@lo:400:kworker.0 00010000:00080000:1.0:1784935492.526676:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442956300 x1871640292057216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935492.526687:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292057216:0@lo:400:kworker.0 00010000:00080000:1.0:1784935492.526696:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442955f80 x1871640292057728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935492.526718:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292057728:0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526728:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292056576:0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526737:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292057088:0@lo:400:kworker.0 00000100:00100000:1.0:1784935492.526745:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292057600:0@lo:400:kworker.0 00002000:00000024:2.0:1784935492.527188:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935492.527229:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292056192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1486us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935492.527237:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1784935492.527276:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443592a00 x1871640292056192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935492.527425:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292056192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935492.527513:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292056320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935492.527546:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935492.527631:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292056832:0@lo:400:kworker.0 00000100:00100000:3.0:1784935492.527654:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935492.528579:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292056320 00000100:00100000:2.0:1784935492.528588:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292056320 00000100:00100000:2.0:1784935492.528632:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784935492.528639:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292056320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784935492.528657:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935492.528695:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292056320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935492.528712:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784935492.529114:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292057344:0@lo:400:kworker.0 00000100:00100000:3.0:1784935492.529175:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935492.529200:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292057856:0@lo:400:kworker.0 00000100:00100000:3.0:1784935492.529218:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784935492.529250:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443666680 x1871640292056320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935492.529266:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292056320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935492.529292:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784935492.529298:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292056448:0@lo:400:kworker.0 00000100:00100000:3.0:1784935492.529321:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935492.529338:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292056960:0@lo:400:kworker.0 00000100:00100000:3.0:1784935492.529358:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935492.529374:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292057472:0@lo:400:kworker.0 00000100:00100000:3.0:1784935492.529404:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784935492.529429:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784935492.529433:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784935492.529436:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784935492.530155:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292057344 00000100:00100000:2.0:1784935492.530163:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292057344 00000100:00100000:2.0:1784935492.530209:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292057856 00000100:00100000:2.0:1784935492.530213:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292057856 00000100:00100000:2.0:1784935492.530225:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292057472 00000100:00100000:2.0:1784935492.530227:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292057472 00000100:00100000:2.0:1784935492.530242:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784935492.530250:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292057344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935492.530328:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292057344:12345-0@lo:400:kworker.0 Request processed in 78us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935492.530334:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784935492.530348:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784935492.530354:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292057856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935492.530380:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292057856:12345-0@lo:400:kworker.0 Request processed in 26us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935492.530386:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784935492.530396:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784935492.530401:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292057472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935492.530426:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292057472:12345-0@lo:400:kworker.0 Request processed in 25us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935492.530431:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784935492.530450:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292056448 00000100:00100000:2.0:1784935492.530453:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292056448 00000100:00100000:2.0:1784935492.530477:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1784935492.530484:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292056448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935492.530512:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292056448:12345-0@lo:400:kworker.0 Request processed in 28us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935492.530516:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:2.0:1784935492.530545:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935492.530578:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292056448:0@lo:400:kworker.0 00010000:00080000:2.0:1784935492.530594:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442955180 x1871640292057472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935492.530605:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292057472:0@lo:400:kworker.0 00010000:00080000:2.0:1784935492.530626:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442954700 x1871640292057344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935492.530634:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292057344:0@lo:400:kworker.0 00010000:00080000:2.0:1784935492.530644:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442957800 x1871640292057856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935492.530651:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292057856:0@lo:400:kworker.0 00000100:00100000:2.0:1784935492.536822:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292056832 00000100:00100000:2.0:1784935492.536838:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292056832 00000100:00100000:2.0:1784935492.536921:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784935492.536946:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292056832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935492.537039:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292056832:12345-0@lo:400:kworker.0 Request processed in 96us (9383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935492.537047:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784935492.537120:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292056832:0@lo:400:kworker.0 00000100:00100000:2.0:1784935492.540623:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292056960 00000100:00100000:2.0:1784935492.540637:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292056960 00000100:00100000:2.0:1784935492.540722:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784935492.540732:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292056960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935492.540830:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292056960:12345-0@lo:400:kworker.0 Request processed in 100us (11470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935492.540838:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784935492.541052:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292056960:0@lo:400:kworker.0 00010000:00010000:0.0:1784935492.724598:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935493.038777:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935493.038797:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292057984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935493.038866:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935493.038924:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292057984 00000100:00100000:3.0:1784935493.038958:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292057984 00000100:00100000:3.0:1784935493.039000:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784935493.039009:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292057984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935493.039035:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935493.039078:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292057984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935493.039086:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1784935493.039251:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443591c00 x1871640292057984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935493.039271:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292057984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935493.040322:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292058112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935493.040370:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935493.040467:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292058112 00000100:00100000:3.0:1784935493.040473:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292058112 00000100:00100000:3.0:1784935493.040513:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784935493.040521:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292058112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784935493.040537:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935493.048307:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292058112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7777us (7927us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935493.048321:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1784935493.048552:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442956d80 x1871640292058112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935493.048574:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292058112:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1784935493.069395:0:12801:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784935493.069616:0:12801:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784935493.293208:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935493.293243:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935493.293276:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935493.293323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935493.293342:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935493.293359:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935493.293381:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935493.293408:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273109120 00000100:00100000:3.0:1784935493.293417:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273109120 00000100:00100000:3.0:1784935493.293472:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 305 00000100:00100000:3.0:1784935493.293482:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2392:x1871640273109120:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935493.293550:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2392:x1871640273109120:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 69us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935493.293558:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 305 00000100:00100000:3.0:1784935493.293588:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273109376 00000100:00100000:3.0:1784935493.293592:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273109376 00000100:00100000:3.0:1784935493.293633:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273109632 00000100:00100000:3.0:1784935493.293636:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273109632 00000100:00100000:3.0:1784935493.293649:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273109248 00000100:00100000:3.0:1784935493.293651:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273109248 00000100:00100000:3.0:1784935493.293661:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273109504 00000100:00100000:3.0:1784935493.293663:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273109504 00000100:00100000:3.0:1784935493.293677:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 155 00000100:00100000:3.0:1784935493.293683:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273109376:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935493.293721:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273109376:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 38us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935493.293728:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 155 00000100:00100000:3.0:1784935493.293740:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 156 00000100:00100000:3.0:1784935493.293746:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273109632:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935493.293769:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273109632:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935493.293781:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 156 00000100:00100000:3.0:1784935493.293793:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 157 00000100:00100000:3.0:1784935493.293799:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273109248:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935493.293822:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273109248:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 23us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935493.293828:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 157 00000100:00100000:3.0:1784935493.293838:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 158 00000100:00100000:3.0:1784935493.293844:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273109504:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935493.293866:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273109504:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 22us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935493.293872:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 158 00000100:00080000:3.0:1784935493.294034:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784935493.294039:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935493.294181:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273109760 00000100:00100000:0.0:1784935493.294186:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273109760 00000100:00100000:0.0:1784935493.294226:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273109888 00000100:00100000:0.0:1784935493.294229:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273109888 00000100:00100000:0.0:1784935493.294250:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:0.0:1784935493.294258:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2390:x1871640273109760:12345-192.168.203.28@tcp:9:kworker.0 00000020:00000080:0.0:1784935493.294278:0:8987:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16665 00000100:00080000:0.0:1784935493.294286:0:8987:0:(import.c:65:import_set_state_nolock()) ffff8d44419c0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784935493.294326:0:8987:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1784935493.294466:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:372b228c-57a7-4786-b20d-41f2845c5abd+2:2390:x1871640273109760:12345-192.168.203.28@tcp:9:kworker.0 Request processed in 208us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935493.294473:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:0.0:1784935493.294496:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:0.0:1784935493.294503:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2390:x1871640273109888:12345-192.168.203.28@tcp:9:kworker.0 00000020:00000080:0.0:1784935493.294514:0:8987:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1666c 00000100:00080000:0.0:1784935493.294520:0:8987:0:(import.c:65:import_set_state_nolock()) ffff8d4443390800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784935493.294541:0:8987:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1784935493.294611:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:372b228c-57a7-4786-b20d-41f2845c5abd+2:2390:x1871640273109888:12345-192.168.203.28@tcp:9:kworker.0 Request processed in 108us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935493.294619:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 23 00010000:00010000:0.0:1784935493.294636:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935493.294669:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784935493.295082:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784935493.295086:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935493.549173:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292058240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935493.549243:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935493.552981:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292058240 00000100:00100000:0.0:1784935493.552996:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292058240 00000100:00100000:0.0:1784935493.553064:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784935493.553076:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292058240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935493.553113:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935493.553208:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292058240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (3965us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935493.553215:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784935493.553999:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292058240:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784935493.742195:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935494.765079:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784935494.944768:0:12898:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784935494.945274:0:12898:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784935495.789563:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935496.109189:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292058368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784935496.109262:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935496.110894:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292058368 00000100:00100000:3.0:1784935496.110908:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292058368 00000100:00100000:3.0:1784935496.110978:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784935496.110988:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292058368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784935496.111027:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784935496.111125:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292058368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935496.111133:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784935496.111211:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292058368:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784935496.814028:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935497.645293:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292058624:0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.645534:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292058496:0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.645595:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935497.645640:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292059008:0@lo:400:kworker.0 00000100:00100000:2.0:1784935497.645660:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935497.645692:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292059136:0@lo:400:kworker.0 00000100:00100000:2.0:1784935497.645716:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935497.645730:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292059648:0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.645761:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935497.645766:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935497.645793:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292059520:0@lo:400:kworker.0 00000100:00100000:2.0:1784935497.645801:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784935497.645810:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292058752:0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.645825:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935497.645844:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935497.645847:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292060032:0@lo:400:kworker.0 00000100:00100000:2.0:1784935497.645869:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292059264:0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.645877:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935497.645898:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935497.645904:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784935497.645913:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292058880:0@lo:400:kworker.0 00000100:00100000:2.0:1784935497.645924:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292059776:0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.645975:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935497.645991:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292059392:0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.646016:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935497.646034:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292059904:0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.646053:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935497.646081:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292059008 00000100:00100000:1.0:1784935497.646088:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292059008 00000100:00100000:1.0:1784935497.646126:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292058752 00000100:00100000:1.0:1784935497.646129:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292058752 00000100:00100000:1.0:1784935497.646145:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784935497.646153:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292059008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.646205:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292059008:12345-0@lo:400:kworker.0 Request processed in 52us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935497.646213:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784935497.646231:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784935497.646237:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292058752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.646265:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292058752:12345-0@lo:400:kworker.0 Request processed in 29us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935497.646271:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784935497.646297:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292059520 00000100:00100000:1.0:1784935497.646301:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292059520 00000100:00100000:3.0:1784935497.647030:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292058624 00000100:00100000:3.0:1784935497.647036:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292058624 00000100:00100000:3.0:1784935497.647060:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292059136 00000100:00100000:3.0:1784935497.647063:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292059136 00000100:00100000:3.0:1784935497.647074:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292059648 00000100:00100000:3.0:1784935497.647076:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292059648 00000100:00100000:3.0:1784935497.647088:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292059264 00000100:00100000:3.0:1784935497.647091:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292059264 00000100:00100000:3.0:1784935497.647102:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292058880 00000100:00100000:3.0:1784935497.647104:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292058880 00000100:00100000:3.0:1784935497.647117:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784935497.647123:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292058624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935497.647172:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292058624:12345-0@lo:400:kworker.0 Request processed in 49us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935497.647179:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784935497.647191:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784935497.647193:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292060032 00000100:00100000:1.0:1784935497.647196:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292060032 00000100:00100000:3.0:1784935497.647197:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292059136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.647211:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292059392 00000100:00100000:1.0:1784935497.647213:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292059392 00000100:00100000:3.0:1784935497.647224:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292059136:12345-0@lo:400:kworker.0 Request processed in 27us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935497.647225:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292059904 00000100:00100000:1.0:1784935497.647227:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292059904 00000100:00100000:3.0:1784935497.647230:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784935497.647239:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784935497.647239:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784935497.647245:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292059648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.647245:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292059520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935497.647270:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292059648:12345-0@lo:400:kworker.0 Request processed in 25us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935497.647271:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292059520:12345-0@lo:400:kworker.0 Request processed in 27us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935497.647275:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784935497.647277:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784935497.647286:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784935497.647286:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784935497.647291:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292059264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.647291:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292060032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935497.647316:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292060032:12345-0@lo:400:kworker.0 Request processed in 25us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935497.647322:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784935497.647323:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292059264:12345-0@lo:400:kworker.0 Request processed in 32us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935497.647328:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784935497.647340:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784935497.647346:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292058880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935497.647372:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292058880:12345-0@lo:400:kworker.0 Request processed in 27us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935497.647377:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784935497.647441:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292058496 00000100:00100000:3.0:1784935497.647445:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292058496 00000100:00100000:3.0:1784935497.647471:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1784935497.647477:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292058496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935497.647506:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292058496:12345-0@lo:400:kworker.0 Request processed in 30us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935497.647512:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1784935497.647538:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784935497.647549:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292060160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935497.647553:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784935497.647559:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292059392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935497.647579:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935497.647584:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292059392:12345-0@lo:400:kworker.0 Request processed in 27us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935497.647590:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784935497.647600:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784935497.647605:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292059904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935497.647619:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292060160 00000100:00100000:3.0:1784935497.647623:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292060160 00000100:00100000:1.0:1784935497.647631:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1871640292059904:12345-0@lo:400:kworker.0 Request processed in 26us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935497.647645:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784935497.647657:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784935497.647663:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d5e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292060160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784935497.647692:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935497.647726:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d5e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292060160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935497.647732:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784935497.647786:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935497.647840:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292058624:0@lo:400:kworker.0 00000100:00100000:2.0:1784935497.647858:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292059136:0@lo:400:kworker.0 00000100:00100000:2.0:1784935497.647874:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292059648:0@lo:400:kworker.0 00000100:00100000:2.0:1784935497.647919:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292058752:0@lo:400:kworker.0 00010000:00080000:2.0:1784935497.647957:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442955c00 x1871640292059264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935497.647968:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292059264:0@lo:400:kworker.0 00000100:00100000:3.0:1784935497.647990:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292059776 00000100:00100000:3.0:1784935497.647996:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292059776 00000100:00100000:3.0:1784935497.648028:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784935497.648036:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292059776:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1784935497.648063:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44429d8000 x1871640292060160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935497.648073:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292059776:12345-0@lo:400:kworker.0 Request processed in 38us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935497.648082:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784935497.648082:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292060160:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1784935497.648117:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442955880 x1871640292059776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935497.648127:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292059776:0@lo:400:kworker.0 00000100:00100000:3.0:1784935497.648136:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292058880:0@lo:400:kworker.0 00010000:00080000:3.0:1784935497.648149:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442954380 x1871640292059392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784935497.648156:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935497.648160:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292059392:0@lo:400:kworker.0 00000100:00080000:2.0:1784935497.648164:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784935497.648168:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784935497.648172:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784935497.648173:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570540a80 x1871640292059904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935497.648182:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292059904:0@lo:400:kworker.0 00000100:00100000:3.0:1784935497.648190:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292058496:0@lo:400:kworker.0 00000100:00100000:3.0:1784935497.648199:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292059008:0@lo:400:kworker.0 00010000:00080000:3.0:1784935497.648209:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442955f80 x1871640292059520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935497.648216:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292059520:0@lo:400:kworker.0 00010000:00080000:3.0:1784935497.648225:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570541500 x1871640292060032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935497.648233:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292060032:0@lo:400:kworker.0 00000100:00100000:2.0:1784935497.648415:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292060288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784935497.648446:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935497.650211:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292060288 00000100:00100000:3.0:1784935497.650238:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292060288 00000100:00100000:3.0:1784935497.650296:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784935497.650305:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292060288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784935497.650329:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935497.650411:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292060288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935497.650419:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1784935497.650562:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44429db800 x1871640292060288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935497.650582:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292060288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784935497.840755:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935498.158536:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935498.158561:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292060416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935498.158631:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935498.158711:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292060416 00000100:00100000:2.0:1784935498.158718:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292060416 00000100:00100000:2.0:1784935498.158762:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784935498.158772:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292060416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784935498.158801:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935498.158848:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292060416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935498.158855:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1784935498.158895:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb5180 x1871640292060416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935498.158965:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292060416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935498.159809:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935498.159829:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292060544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935498.159880:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935498.160787:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292060544 00000100:00100000:2.0:1784935498.160797:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292060544 00000100:00100000:2.0:1784935498.160847:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784935498.160856:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292060544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784935498.160878:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935498.161066:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292060544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 210us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935498.161074:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1784935498.165152:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb5180 x1871640292060544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935498.165179:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292060544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935498.411187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935498.411282:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935498.411307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935498.411326:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935498.411346:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935498.411371:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273110272 00000100:00100000:3.0:1784935498.411379:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273110272 00000100:00100000:3.0:1784935498.411433:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273110528 00000100:00100000:3.0:1784935498.411437:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273110528 00000100:00100000:3.0:1784935498.411450:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273110144 00000100:00100000:3.0:1784935498.411452:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273110144 00000100:00100000:3.0:1784935498.411462:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273110400 00000100:00100000:3.0:1784935498.411464:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273110400 00000100:00100000:3.0:1784935498.411479:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 165 00000100:00100000:3.0:1784935498.411488:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273110272:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935498.411558:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273110272:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 71us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935498.411566:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 165 00000100:00100000:3.0:1784935498.411582:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 166 00000100:00100000:3.0:1784935498.411589:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273110528:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935498.411615:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273110528:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 26us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935498.411630:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 166 00000100:00100000:3.0:1784935498.411643:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 167 00000100:00100000:3.0:1784935498.411648:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273110144:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935498.411691:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273110144:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 42us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935498.411697:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 167 00000100:00100000:3.0:1784935498.411708:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 168 00000100:00100000:3.0:1784935498.411715:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273110400:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935498.411738:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273110400:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935498.411744:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 168 00000100:00080000:3.0:1784935498.411770:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784935498.411774:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935498.415741:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273110016 00000100:00100000:1.0:1784935498.415758:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273110016 00000100:00100000:0.0:1784935498.416047:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 307 00000100:00100000:0.0:1784935498.416061:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2391:x1871640273110016:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935498.416148:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2391:x1871640273110016:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 90us (4972us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935498.416157:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 307 00000001:02000400:2.0:1784935498.429495:0:13042:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1784935498.673108:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 372b228c-57a7-4786-b20d-41f2845c5abd 00000020:00000080:2.0:1784935498.673118:0:9518:0:(genops.c:906:class_export_put()) final put ffff8d4443392000/372b228c-57a7-4786-b20d-41f2845c5abd 00000020:00000080:1.0:1784935498.673184:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4443392000/372b228c-57a7-4786-b20d-41f2845c5abd for lustre-OST0001 00000020:00000080:1.0:1784935498.673246:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4443390800 for lustre-OST0001 00000100:00100000:0.0:1784935498.673369:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935498.673391:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292060672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935498.673468:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935498.673590:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292060672 00000100:00100000:1.0:1784935498.673597:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292060672 00000100:00100000:1.0:1784935498.673669:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784935498.673678:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292060672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784935498.673716:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784935498.673775:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292060672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935498.673783:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784935498.673975:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292060672:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1784935498.687510:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 372b228c-57a7-4786-b20d-41f2845c5abd 00000020:00000080:0.0:1784935498.687519:0:8431:0:(genops.c:906:class_export_put()) final put ffff8d44419c3800/372b228c-57a7-4786-b20d-41f2845c5abd 00000020:00000080:2.0:1784935498.687764:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44419c3800/372b228c-57a7-4786-b20d-41f2845c5abd for lustre-OST0000 00000020:00000080:2.0:1784935498.687817:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d44419c0800 for lustre-OST0000 00010000:00010000:1.0:1784935498.861670:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935499.889004:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935500.909214:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935501.229267:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292060800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784935501.229404:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935501.229561:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292060800 00000100:00100000:0.0:1784935501.229568:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292060800 00000100:00100000:0.0:1784935501.229628:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784935501.229707:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292060800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935501.229742:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784935501.229791:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292060800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935501.229798:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784935501.229889:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292060800:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1784935501.878350:0:13190:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdeb3763e0 20000000:00000080:2.0:1784935501.878366:0:13190:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d4581ee1400 uarg=0000000000000000 20000000:01000000:2.0:1784935501.878405:0:13190:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784935501.878410:0:13190:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784935501.878414:0:13190:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784935501.879339:0:13191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1784935501.879562:0:13190:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784935501.887378:0:13190:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784935501.887411:0:13190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.887430:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b165a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b165a1 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.887546:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4541528200/0x857e02f4e0b165d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b165cb expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.887569:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b165fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b165f5 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.887575:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d457d300800/0x857e02f4e0b16626 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1661f expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.887585:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b1662d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a844 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.887593:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a883 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.887599:0:13190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.887652:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a883 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.887669:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a883 expref: 12 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935501.887685:0:13190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44431f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292060928:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935501.888255:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b1662d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a844 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.888265:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b1662d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a844 expref: 12 pid: 6517 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935501.888273:0:13190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292061056:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935501.889889:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d457d300800/0x857e02f4e0b16626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b1661f expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.889905:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d457d300800/0x857e02f4e0b16626 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b1661f expref: 23 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935501.889919:0:13190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292061184:0@lo:104: 00000100:00100000:3.0:1784935501.890172:0:13190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784935501.890254:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b165fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b165f5 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.890262:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b165fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b165f5 expref: 23 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935501.890271:0:13190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292061312:0@lo:104: 00000100:00100000:3.0:1784935501.890292:0:13190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784935501.890432:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4541528200/0x857e02f4e0b165d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b165cb expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935501.890456:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4541528200/0x857e02f4e0b165d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b165cb expref: 23 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935501.890464:0:13190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292061440:0@lo:104: 00000100:00100000:3.0:1784935501.890485:0:13190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935501.898800:0:6509:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292061184 00000100:00100000:2.0:1784935501.898815:0:6509:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292061184 00000100:00100000:1.0:1784935501.898943:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292061312 00000100:00100000:1.0:1784935501.898947:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292061312 00000100:00100000:1.0:1784935501.898974:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784935501.898982:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:13190:x1871640292061184:12345-0@lo:104: 00010000:00010000:1.0:1784935501.899012:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899111:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784935501.899117:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:13190:x1871640292061184:12345-0@lo:104: Request processed in 135us (8946us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935501.899123:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784935501.899140:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784935501.899146:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:13190:x1871640292061312:12345-0@lo:104: 00010000:00010000:1.0:1784935501.899154:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899183:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784935501.899187:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:13190:x1871640292061312:12345-0@lo:104: Request processed in 42us (8895us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935501.899192:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1784935501.899212:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784935501.899217:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899225:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6c800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935501.899228:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899235:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935501.899242:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935501.899253:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784935501.899287:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899293:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935501.899309:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899317:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b1661f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16626 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899331:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784935501.899333:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899339:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166ae00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935501.899342:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899348:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935501.899354:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935501.899358:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784935501.899370:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899376:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935501.899388:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899393:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166ae00/0x857e02f4e0b165f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b165fc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.899403:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935501.899404:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935501.899406:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935501.899425:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292061568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935501.899474:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935501.899509:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935501.899515:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292061696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935501.899533:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935501.900634:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292061440 00000100:00100000:0.0:1784935501.900650:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292061440 00000100:00100000:0.0:1784935501.900683:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784935501.900691:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:13190:x1871640292061440:12345-0@lo:104: 00010000:00010000:0.0:1784935501.900703:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935501.900769:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935501.900775:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:13190:x1871640292061440:12345-0@lo:104: Request processed in 85us (10288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935501.900791:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1784935501.900837:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b165a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b165a1 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935501.900849:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b165a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b165a1 expref: 23 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935501.900859:0:13190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292061824:0@lo:104: 00000100:00100000:0.0:1784935501.900885:0:13190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935501.900904:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292061824 00000100:00100000:0.0:1784935501.900909:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292061824 00000100:00100000:0.0:1784935501.900944:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784935501.900951:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:13190:x1871640292061824:12345-0@lo:104: 00010000:00010000:0.0:1784935501.900959:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935501.900987:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784935501.900991:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:13190:x1871640292061824:12345-0@lo:104: Request processed in 41us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935501.900997:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784935501.901015:0:13190:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4561758600 going to sleep for 11 seconds 00000100:00100000:0.0:1784935501.901050:0:13190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292061184:0@lo:104: 00000100:00100000:0.0:1784935501.901059:0:13190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292061312:0@lo:104: 00000100:00100000:0.0:1784935501.901067:0:13190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292061440:0@lo:104: 00000100:00100000:0.0:1784935501.901073:0:13190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292061824:0@lo:104: 00010000:00010000:2.0:1784935501.901919:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784935501.901939:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.901948:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529e00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935501.901962:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.901971:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935501.901977:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935501.901983:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784935501.902016:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902034:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935501.902055:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902062:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4541529e00/0x857e02f4e0b165cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b165d2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902076:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935501.902079:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902086:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540031800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935501.902088:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902095:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935501.902111:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935501.902116:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784935501.902130:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902136:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935501.902142:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902148:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b165a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b165a8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902161:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935501.902163:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935501.902164:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935501.902178:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292061568 00000100:00100000:2.0:1784935501.902183:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292061568 00010000:00010000:2.0:1784935501.902207:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d457d300800/0x857e02f4e0b16626 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1661f expref: 24 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935501.902226:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292061696 00000100:00100000:2.0:1784935501.902229:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292061696 00010000:00010000:2.0:1784935501.902240:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b165fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b165f5 expref: 25 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935501.902257:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784935501.902263:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+25:3651:x1871640292061568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784935501.902275:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935501.902285:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d457d300800/0x857e02f4e0b16626 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1661f expref: 25 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902294:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d457d300800/0x857e02f4e0b16626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b1661f expref: 25 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902306:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d300800/0x857e02f4e0b16626 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b1661f expref: 25 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902321:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935501.902368:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292061568:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (2893us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935501.902375:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784935501.902390:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784935501.902396:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:3651:x1871640292061696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784935501.902404:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935501.902408:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b165fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b165f5 expref: 23 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902416:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b165fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b165f5 expref: 23 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902426:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166aa00/0x857e02f4e0b165fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b165f5 expref: 23 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902436:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935501.902467:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:3651:x1871640292061696:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935501.902473:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784935501.902507:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292061952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935501.902544:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935501.902566:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935501.902572:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292062080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935501.902590:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935501.902613:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292061952 00000100:00100000:2.0:1784935501.902617:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292061952 00010000:00010000:2.0:1784935501.902632:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4541528200/0x857e02f4e0b165d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b165cb expref: 22 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935501.902656:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292062080 00000100:00100000:2.0:1784935501.902659:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292062080 00010000:00010000:2.0:1784935501.902669:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b165a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b165a1 expref: 23 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935501.902682:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784935501.902687:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:3649:x1871640292061952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784935501.902694:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935501.902697:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4541528200/0x857e02f4e0b165d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b165cb expref: 23 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902705:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4541528200/0x857e02f4e0b165d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b165cb expref: 23 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902715:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541528200/0x857e02f4e0b165d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b165cb expref: 23 pid: 6517 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902723:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935501.902749:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:3649:x1871640292061952:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935501.902754:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784935501.902784:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784935501.902790:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3649:x1871640292062080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784935501.902799:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935501.902804:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b165a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b165a1 expref: 21 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902812:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b165a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b165a1 expref: 21 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902821:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b165a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b165a1 expref: 21 pid: 6518 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935501.902829:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935501.902850:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3649:x1871640292062080:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935501.902856:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784935501.902889:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292062080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935501.902897:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292061952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935501.902954:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292061696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935501.902962:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292061568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935501.904887:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935501.909988:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935501.910138:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273110656 00000100:00100000:1.0:1784935501.910148:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273110656 00010000:00010000:1.0:1784935501.910186:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16650 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a883 expref: 13 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935501.910218:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 44 00000100:00100000:1.0:1784935501.910228:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2391:x1871640273110656:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935501.910244:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935501.910250:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16650 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a883 expref: 13 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.910263:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a883 expref: 13 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.910282:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935501.917247:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2391:x1871640273110656:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 7008us (7256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935501.917263:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 44 00000100:00100000:0.0:1784935501.918913:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00010000:00010000:2.0:1784935501.920256:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16650 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a883 expref: 12 pid: 6518 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935501.920276:0:13190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44431f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292060928:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935501.920304:0:13190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1871640292061056:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935501.920337:0:13190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935501.920739:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273110784 00000100:00100000:1.0:1784935501.920748:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273110784 00010000:00010000:1.0:1784935501.920842:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b1662d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a844 expref: 12 pid: 6517 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935501.920911:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 45 00000100:00100000:1.0:1784935501.920921:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45729c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:2392:x1871640273110784:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935501.920956:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935501.920963:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b1662d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a844 expref: 12 pid: 6517 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.920974:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b1662d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a844 expref: 12 pid: 6517 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.920992:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d301a00/0x857e02f4e0b1662d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a844 expref: 12 pid: 6517 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.921005:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.921013:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.921129:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.921138:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.921153:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.921159:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.921165:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935501.921169:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.921176:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935501.921313:0:13190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935501.921321:0:13190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.922576:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.922589:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541529000/0x857e02f4e0b16673 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935501.922606:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935501.922685:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45729c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:2392:x1871640273110784:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 1762us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935501.922695:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 45 00010000:00010000:2.0:1784935501.943471:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935502.765206:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292062208:0@lo:400:kworker.0 00000100:00100000:2.0:1784935502.765284:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935502.765690:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292062208 00000100:00100000:1.0:1784935502.765698:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292062208 00000100:00100000:1.0:1784935502.765752:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1784935502.765760:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3651:x1871640292062208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935502.768990:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292062720:0@lo:400:kworker.0 00000100:00100000:2.0:1784935502.769070:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935502.778311:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292062720 00000100:00100000:3.0:1784935502.779226:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292062720 00000100:00100000:3.0:1784935502.779290:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784935502.779299:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292062720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.779407:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292062720:12345-0@lo:400:kworker.0 Request processed in 109us (10336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935502.779522:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784935502.779663:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292062464:0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.786150:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292062592:0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.786310:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935502.786355:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292062976:0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.786392:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935502.786490:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292063488:0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.786515:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935502.786535:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292064000:0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.786551:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935502.786580:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292062336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935502.786589:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935502.786614:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292063104:0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.786653:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935502.786670:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292063616:0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.786701:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935502.786902:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292062976 00000100:00100000:0.0:1784935502.786910:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292062976 00000100:00100000:0.0:1784935502.786968:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292062592 00000100:00100000:0.0:1784935502.786971:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292062592 00000100:00100000:0.0:1784935502.786987:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784935502.786994:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292062976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.787045:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292062976:12345-0@lo:400:kworker.0 Request processed in 51us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.787052:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784935502.787070:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784935502.787076:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292062592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.787107:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292062592:12345-0@lo:400:kworker.0 Request processed in 31us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.787113:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784935502.787147:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292062592:0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.787218:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935502.787238:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292062848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935502.787256:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935502.787271:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292063360:0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.787288:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935502.787302:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292063872:0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.787318:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935502.787339:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784935502.787349:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292063232:0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.787374:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935502.787393:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292063744:0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.787410:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935502.787463:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292063488 00000100:00100000:0.0:1784935502.787467:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292063488 00000100:00100000:0.0:1784935502.787500:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292064000 00000100:00100000:0.0:1784935502.787503:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292064000 00000100:00100000:0.0:1784935502.787517:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292063360 00000100:00100000:0.0:1784935502.787520:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292063360 00000100:00100000:0.0:1784935502.787534:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292063872 00000100:00100000:0.0:1784935502.787537:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292063872 00000100:00100000:0.0:1784935502.787552:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784935502.787561:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292063488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.787599:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292063488:12345-0@lo:400:kworker.0 Request processed in 40us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.787605:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784935502.787616:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784935502.787622:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292064000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.787807:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292064000:12345-0@lo:400:kworker.0 Request processed in 185us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.787814:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784935502.787825:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784935502.787830:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292063360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.787855:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292063360:12345-0@lo:400:kworker.0 Request processed in 25us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.787860:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784935502.787868:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784935502.787873:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292063872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.787892:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292063872:12345-0@lo:400:kworker.0 Request processed in 20us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.787906:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1784935502.787968:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784935502.787972:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784935502.787984:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292062336 00000100:00100000:0.0:1784935502.787987:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292062336 00000100:00100000:0.0:1784935502.788001:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292062848 00000100:00100000:0.0:1784935502.788384:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292062848 00000100:00100000:0.0:1784935502.788466:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784935502.788472:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292062336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935502.788494:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935502.788527:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292062336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.788532:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784935502.788543:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784935502.788548:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292062848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784935502.788555:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935502.788572:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292062848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 24us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.788577:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784935502.788596:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292062464 00000100:00100000:0.0:1784935502.788599:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292062464 00000100:00100000:0.0:1784935502.788613:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292063104 00000100:00100000:0.0:1784935502.788615:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292063104 00000100:00100000:0.0:1784935502.788647:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292063616 00000100:00100000:0.0:1784935502.788649:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292063616 00000100:00100000:0.0:1784935502.788660:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292063232 00000100:00100000:0.0:1784935502.788662:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292063232 00000100:00100000:0.0:1784935502.788671:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292063744 00000100:00100000:0.0:1784935502.789007:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292063744 00000100:00100000:0.0:1784935502.789030:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784935502.789035:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292062464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.789080:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292062464:12345-0@lo:400:kworker.0 Request processed in 45us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.789085:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784935502.789095:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1784935502.789102:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292063104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.789133:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292063104:12345-0@lo:400:kworker.0 Request processed in 32us (2480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.789138:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1784935502.789147:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784935502.789153:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292063616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.789971:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292063616:12345-0@lo:400:kworker.0 Request processed in 814us (3265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.789979:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784935502.789996:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784935502.790003:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292063232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.790029:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292063232:12345-0@lo:400:kworker.0 Request processed in 28us (2655us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.790034:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784935502.790042:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784935502.790047:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292063744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.790067:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292063744:12345-0@lo:400:kworker.0 Request processed in 20us (2656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935502.790081:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1784935502.790105:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935502.790109:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935502.790140:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292063104:0@lo:400:kworker.0 00000100:00100000:0.0:1784935502.790151:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292063616:0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.791264:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292062976:0@lo:400:kworker.0 00010000:00080000:3.0:1784935502.791285:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434c6300 x1871640292063488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935502.791295:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292063488:0@lo:400:kworker.0 00010000:00080000:3.0:1784935502.791317:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443431500 x1871640292064000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935502.791326:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292064000:0@lo:400:kworker.0 00000100:00100000:3.0:1784935502.791340:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292062464:0@lo:400:kworker.0 00010000:00080000:3.0:1784935502.791403:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434c4700 x1871640292063232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935502.791412:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292063232:0@lo:400:kworker.0 00010000:00080000:3.0:1784935502.791423:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443432a00 x1871640292063744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935502.791429:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292063744:0@lo:400:kworker.0 00010000:00080000:3.0:1784935502.791451:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d4a80 x1871640292062336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935502.791467:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292062336:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1784935502.791478:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d7480 x1871640292062848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935502.791489:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292062848:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1784935502.791500:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434c4a80 x1871640292063360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935502.791516:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292063360:0@lo:400:kworker.0 00010000:00080000:3.0:1784935502.791527:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443432680 x1871640292063872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935502.791534:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292063872:0@lo:400:kworker.0 00000100:00100000:1.0:1784935502.791898:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3651:x1871640292062208:12345-0@lo:400:kworker.0 Request processed in 26134us (26610us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935502.791921:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1784935502.792321:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292062208:0@lo:400:kworker.0 00000100:00100000:2.0:1784935502.792349:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292062720:0@lo:400:kworker.0 00010000:00010000:3.0:1784935502.960765:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935503.277106:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784935503.277128:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292064128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935503.277195:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935503.279657:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292064128 00000100:00100000:2.0:1784935503.279670:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292064128 00000100:00100000:2.0:1784935503.279744:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784935503.279754:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292064128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784935503.279789:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935503.279876:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292064128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (2681us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935503.279883:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1784935503.279908:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb4a80 x1871640292064128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935503.279943:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292064128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935503.288586:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292064256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935503.288680:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935503.289884:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292064256 00000100:00100000:1.0:1784935503.289896:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292064256 00000100:00100000:1.0:1784935503.289979:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784935503.289991:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292064256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784935503.290017:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935503.290102:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292064256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935503.290109:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1784935503.290166:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428aed80 x1871640292064256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935503.290187:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292064256:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1784935503.341066:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784935503.341073:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457d24e000 from 7 10000000:01000000:0.0:1784935503.341085:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784935503.341141:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935503.341161:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935503.341171:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935503.341203:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292064384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784935503.341297:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935503.341400:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474a3300 going to sleep for 11 seconds 00000100:00100000:3.0:1784935503.343268:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292064384 00000100:00100000:3.0:1784935503.343280:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292064384 00000100:00100000:3.0:1784935503.343351:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1784935503.343362:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292064384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935503.343376:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935503.343393:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541529400/0x857e02f4e0b16681 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1667a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.343426:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541529400/0x857e02f4e0b16681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1667a expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.343455:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541529400/0x857e02f4e0b16681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1667a expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.343469:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529400, rc 0) 00000100:00100000:3.0:1784935503.343558:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292064384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935503.343564:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1784935503.343684:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292064384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935503.343711:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935503.343721:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935503.343813:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292064512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935503.343854:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935503.343893:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44421fccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935503.343964:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292064512 00000100:00100000:3.0:1784935503.343969:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292064512 00000100:00100000:3.0:1784935503.344018:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784935503.344025:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292064512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784935503.344267:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292064512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935503.344274:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1784935503.344341:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292064512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935503.344369:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292064640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935503.344409:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935503.344435:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44421fccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935503.344504:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292064640 00000100:00100000:3.0:1784935503.344509:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292064640 00000100:00100000:3.0:1784935503.344581:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1784935503.344588:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292064640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784935503.344706:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292064640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935503.344713:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1784935503.344755:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292064640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784935503.345423:0:13221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784935503.345479:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784935503.345498:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784935503.345507:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935503.345516:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935503.345537:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784935503.345540:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457b962000 from 7 10000000:01000000:2.0:1784935503.345542:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784935503.345568:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935503.345574:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935503.345582:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935503.345599:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292064768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784935503.350376:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935503.350531:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2600 going to sleep for 11 seconds 00000100:00100000:1.0:1784935503.350798:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292064768 00000100:00100000:1.0:1784935503.350807:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292064768 00000100:00100000:1.0:1784935503.350880:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1784935503.350889:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292064768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935503.350907:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935503.350924:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4442a6d800/0x857e02f4e0b1668f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16688 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935503.351252:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4442a6d800/0x857e02f4e0b1668f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16688 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935503.351265:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4442a6d800/0x857e02f4e0b1668f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16688 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935503.351275:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6d800, rc 0) 00000100:00100000:2.0:1784935503.351334:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292064768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 446us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935503.351341:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1784935503.351423:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292064768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935503.351442:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935503.351452:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935503.351742:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292064896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935503.351780:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935503.351821:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474a36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935503.351877:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292064896 00000100:00100000:2.0:1784935503.351882:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292064896 00000100:00100000:2.0:1784935503.351915:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1784935503.351922:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292064896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935503.352167:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292064896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935503.352174:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1784935503.361188:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292064896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935503.361265:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935503.361337:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935503.361412:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474a36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935503.369105:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292065024 00000100:00100000:2.0:1784935503.369122:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292065024 00000100:00100000:2.0:1784935503.369187:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1784935503.369197:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292065024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935503.369376:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292065024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (8037us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935503.369384:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1784935503.369667:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784935503.370465:0:13223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784935503.370654:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784935503.370677:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784935503.370688:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935503.370699:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935503.370709:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784935503.370712:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4570c47800 from 7 10000000:01000000:0.0:1784935503.370715:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784935503.370746:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935503.370753:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935503.370762:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935503.370796:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784935503.370852:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935503.370891:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474a39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935503.371645:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292065152 00000100:00100000:3.0:1784935503.371654:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292065152 00000100:00100000:3.0:1784935503.372665:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1784935503.372679:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292065152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935503.372696:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935503.372712:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541529000/0x857e02f4e0b1669d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16696 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.372736:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541529000/0x857e02f4e0b1669d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16696 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.372746:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541529000/0x857e02f4e0b1669d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16696 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.372753:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529000, rc 0) 00000100:00100000:3.0:1784935503.372826:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292065152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935503.372833:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1784935503.372955:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935503.372972:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935503.372981:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935503.373053:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935503.373086:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935503.377151:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935503.377170:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292065280 00000100:00100000:2.0:1784935503.377180:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292065280 00000100:00100000:2.0:1784935503.377281:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1784935503.377291:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292065280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935503.377439:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292065280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (4351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935503.377447:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1784935503.377597:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935503.377662:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935503.377709:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935503.377724:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474a39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935503.377738:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292065408 00000100:00100000:0.0:1784935503.377742:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292065408 00000100:00100000:0.0:1784935503.377764:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1784935503.377772:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292065408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935503.377858:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292065408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935503.377864:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1784935503.377953:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784935503.380794:0:13224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784935503.380910:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784935503.380954:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784935503.380965:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935503.380977:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935503.380987:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784935503.380989:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4570329000 from 7 10000000:01000000:1.0:1784935503.380991:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784935503.381030:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935503.381039:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935503.381049:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935503.381074:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935503.381137:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935503.381174:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44421fc540 going to sleep for 11 seconds 00000100:00100000:1.0:1784935503.381192:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292065536 00000100:00100000:1.0:1784935503.381206:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292065536 00000100:00100000:1.0:1784935503.381249:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1784935503.381257:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292065536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935503.381270:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935503.381281:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b166ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b166a4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935503.381303:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b166ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b166a4 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935503.381314:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b166ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b166a4 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935503.381321:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6da00, rc 0) 00000100:00100000:1.0:1784935503.381358:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292065536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935503.381365:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1784935503.381406:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935503.381418:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935503.381426:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935503.381474:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935503.381497:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935503.381510:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44421fc540 going to sleep for 11 seconds 00000100:00100000:1.0:1784935503.381521:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292065664 00000100:00100000:1.0:1784935503.381530:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292065664 00000100:00100000:1.0:1784935503.381547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1784935503.381553:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292065664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935503.381671:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292065664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935503.381676:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1784935503.381702:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935503.381725:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935503.381762:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935503.381778:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292065792 00000100:00100000:1.0:1784935503.381778:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44421fc540 going to sleep for 11 seconds 00000100:00100000:3.0:1784935503.381785:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292065792 00000100:00100000:3.0:1784935503.381824:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1784935503.381832:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292065792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784935503.381913:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292065792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935503.381919:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1784935503.383719:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292065792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784935503.387540:0:13226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784935503.388057:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784935503.388083:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784935503.388095:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935503.388108:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935503.528809:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935503.529588:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935503.529639:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935503.529665:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935503.529685:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935503.529752:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935503.529781:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273111296 00000100:00100000:2.0:1784935503.529790:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273111296 00000100:00100000:2.0:1784935503.529848:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273111552 00000100:00100000:2.0:1784935503.529851:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273111552 00000100:00100000:2.0:1784935503.529864:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273111168 00000100:00100000:2.0:1784935503.529873:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273111168 00000100:00100000:2.0:1784935503.529891:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273111424 00000100:00100000:2.0:1784935503.529893:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273111424 00000100:00100000:2.0:1784935503.529908:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 175 00000100:00100000:2.0:1784935503.529916:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273111296:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935503.530909:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273111296:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 988us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935503.530919:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 175 00000100:00100000:2.0:1784935503.530963:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 176 00000100:00100000:2.0:1784935503.530972:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273111552:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935503.531412:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273110912 00000100:00100000:3.0:1784935503.531419:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273110912 00000100:00100000:3.0:1784935503.531455:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273111040 00000100:00100000:3.0:1784935503.531459:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273111040 00000100:00100000:3.0:1784935503.531474:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 321 00000100:00100000:3.0:1784935503.531490:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273110912:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935503.531504:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935503.531525:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b166b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a8b4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.531551:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b166b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8b4 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.531561:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b166b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8b4 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.531569:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529c00, rc 0) 00000100:00100000:3.0:1784935503.531613:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:6162:x1871640273110912:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 Request processed in 108us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935503.531620:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 321 00000100:00100000:3.0:1784935503.531655:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 322 00000100:00100000:3.0:1784935503.531663:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:2392:x1871640273111040:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935503.531686:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:2392:x1871640273111040:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 24us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935503.531692:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 322 00000100:00100000:2.0:1784935503.532746:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273111552:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 1769us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935503.532756:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 176 00000100:00100000:2.0:1784935503.532780:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 177 00000100:00100000:2.0:1784935503.532788:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273111168:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935503.532814:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273111168:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 28us (3127us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935503.532819:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 177 00000100:00100000:2.0:1784935503.532831:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 178 00000100:00100000:2.0:1784935503.532837:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273111424:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935503.532864:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273111424:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 28us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935503.532869:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 178 00000100:00080000:2.0:1784935503.532901:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784935503.532915:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935503.538871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935503.538971:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273111680 00000100:00100000:2.0:1784935503.538981:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273111680 00000100:00100000:2.0:1784935503.539043:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 323 00000100:00100000:2.0:1784935503.539061:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273111680:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935503.539207:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273111680:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 Request processed in 156us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935503.539215:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 323 00000100:00100000:2.0:1784935503.543914:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935503.544015:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273111808 00000100:00100000:0.0:1784935503.544026:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273111808 00000100:00100000:0.0:1784935503.544095:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 324 00000100:00100000:0.0:1784935503.544106:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273111808:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935503.544241:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273111808:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 Request processed in 137us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935503.544249:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 324 00000100:00100000:0.0:1784935503.562151:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935503.563341:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273111936 00000100:00100000:3.0:1784935503.563354:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273111936 00000100:00100000:3.0:1784935503.563406:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 325 00000100:00100000:3.0:1784935503.563416:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273111936:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935503.563432:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935503.563457:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541528200/0x857e02f4e0b166b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a8bb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.563484:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541528200/0x857e02f4e0b166b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8bb expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.563495:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541528200/0x857e02f4e0b166b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8bb expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935503.563505:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541528200, rc 0) 00000100:00100000:3.0:1784935503.563570:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:6162:x1871640273111936:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 Request processed in 155us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935503.563577:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 325 00000100:00100000:1.0:1784935503.569267:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935503.569363:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273112064 00000100:00100000:0.0:1784935503.569372:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273112064 00000100:00100000:0.0:1784935503.569427:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 326 00000100:00100000:0.0:1784935503.569437:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:6162:x1871640273112064:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935503.569581:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:6162:x1871640273112064:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 Request processed in 145us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935503.569589:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 326 00000100:00100000:0.0:1784935503.576671:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935503.576773:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273112192 00000100:00100000:1.0:1784935503.576783:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273112192 00000100:00100000:1.0:1784935503.576839:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 327 00000100:00100000:1.0:1784935503.576848:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:6162:x1871640273112192:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935503.577011:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:6162:x1871640273112192:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 Request processed in 163us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935503.577019:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 327 00000100:00100000:1.0:1784935503.789113:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935503.789137:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292065920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784935503.789210:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935503.789245:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292065920 00000100:00100000:0.0:1784935503.789254:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292065920 00000100:00100000:0.0:1784935503.789317:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784935503.789327:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292065920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935503.789374:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935503.789423:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292065920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935503.789430:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784935503.789444:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292065920:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784935503.981122:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935505.006707:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935506.031245:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784935506.279301:0:13388:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1784935506.349283:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292066048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784935506.349349:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935506.349467:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292066048 00000100:00100000:0.0:1784935506.349633:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292066048 00000100:00100000:0.0:1784935506.349690:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784935506.349701:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292066048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935506.349746:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784935506.349794:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292066048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935506.349801:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784935506.350207:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292066048:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784935507.053355:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935507.886613:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292066176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935507.886682:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935507.886708:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292066176 00000100:00100000:3.0:1784935507.886715:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292066176 00000100:00100000:3.0:1784935507.886765:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784935507.886780:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292066176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784935507.886809:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935507.886855:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292066176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935507.887375:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935507.887387:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292066304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935507.887421:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784935507.888513:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784935507.893219:0:8443:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1784935507.893244:0:8443:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1784935507.893550:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292066816:0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.893623:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935507.893661:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292067328:0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.893686:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935507.893708:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784935507.893714:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292066432:0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.893741:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935507.893760:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292066944:0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.893786:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935507.893802:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292067456:0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.893821:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935507.893843:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292066560:0@lo:400:kworker.0 00000100:00100000:0.0:1784935507.893871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935507.893890:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292067072:0@lo:400:kworker.0 00000100:00100000:0.0:1784935507.893907:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935507.893921:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292067584:0@lo:400:kworker.0 00000100:00100000:0.0:1784935507.893957:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935507.893974:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784935507.893979:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292066688:0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.893983:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292066816 00000100:00100000:1.0:1784935507.893990:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292066816 00000100:00100000:0.0:1784935507.893999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935507.894013:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292067200:0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.894031:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292066560 00000100:00100000:1.0:1784935507.894035:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292066560 00000100:00100000:0.0:1784935507.894040:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935507.894046:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292067072 00000100:00100000:1.0:1784935507.894048:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292067072 00000100:00100000:0.0:1784935507.894050:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292067712:0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.894065:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292067584 00000100:00100000:0.0:1784935507.894067:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935507.894068:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292067584 00000100:00100000:1.0:1784935507.894079:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292067200 00000100:00100000:1.0:1784935507.894081:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292067200 00000100:00100000:0.0:1784935507.894085:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292067712 00000100:00100000:0.0:1784935507.894088:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292067712 00000100:00100000:1.0:1784935507.894096:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784935507.894103:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292066816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935507.894104:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784935507.894109:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292066560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.894155:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292066816:12345-0@lo:400:kworker.0 Request processed in 51us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935507.894155:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292066560:12345-0@lo:400:kworker.0 Request processed in 44us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935507.894162:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784935507.894712:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784935507.894733:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292066304 00000100:00100000:3.0:1784935507.894738:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292066304 00000100:00100000:3.0:1784935507.894770:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784935507.894776:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292066304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784935507.894793:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935507.894834:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292066304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (7413us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935507.894840:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1784935507.894879:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44428aca80 x1871640292066176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935507.894900:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292066176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935507.895488:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784935507.895511:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784935507.895520:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292067072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.895564:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292067072:12345-0@lo:400:kworker.0 Request processed in 47us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935507.895571:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784935507.895583:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784935507.895589:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292067584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.895628:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292067584:12345-0@lo:400:kworker.0 Request processed in 39us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935507.895634:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784935507.895645:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784935507.895651:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292067200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.895678:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292067200:12345-0@lo:400:kworker.0 Request processed in 28us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935507.895685:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784935507.895696:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784935507.895702:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292067712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.895730:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292067712:12345-0@lo:400:kworker.0 Request processed in 28us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935507.895735:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784935507.895760:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292067328 00000100:00100000:1.0:1784935507.895765:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292067328 00000100:00100000:1.0:1784935507.895821:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292067456 00000100:00100000:1.0:1784935507.895824:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292067456 00000100:00100000:1.0:1784935507.895849:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784935507.895855:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292067328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.895889:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292067328:12345-0@lo:400:kworker.0 Request processed in 34us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935507.895894:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784935507.895905:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784935507.895910:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292067456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.895959:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292067456:12345-0@lo:400:kworker.0 Request processed in 48us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935507.895965:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784935507.895985:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292066432 00000100:00100000:1.0:1784935507.895989:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292066432 00000100:00100000:1.0:1784935507.896013:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1784935507.896018:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292066432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.896047:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292066432:12345-0@lo:400:kworker.0 Request processed in 28us (2305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935507.896052:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1784935507.896081:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292066944 00000100:00100000:1.0:1784935507.896085:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292066944 00000100:00100000:1.0:1784935507.896106:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292066688 00000100:00100000:1.0:1784935507.896109:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292066688 00000100:00100000:1.0:1784935507.896120:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784935507.896124:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292066944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.896154:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292066944:12345-0@lo:400:kworker.0 Request processed in 29us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935507.896170:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784935507.896182:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784935507.896187:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292066688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.896218:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292066688:12345-0@lo:400:kworker.0 Request processed in 31us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935507.896223:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784935507.897363:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292066432:0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.897380:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292066944:0@lo:400:kworker.0 00000100:00080000:2.0:1784935507.897418:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784935507.897424:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784935507.897427:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784935507.897429:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935507.897865:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292066688:0@lo:400:kworker.0 00010000:00080000:0.0:1784935507.897880:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bdc00 x1871640292067200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935507.897890:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292067200:0@lo:400:kworker.0 00010000:00080000:0.0:1784935507.897901:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434be300 x1871640292067712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935507.897909:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292067712:0@lo:400:kworker.0 00000100:00100000:0.0:1784935507.897921:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292066560:0@lo:400:kworker.0 00010000:00080000:2.0:1784935507.898012:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb5f80 x1871640292066304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935507.898029:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292066304:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1784935507.899645:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bd880 x1871640292067456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935507.899669:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292067456:0@lo:400:kworker.0 00000100:00100000:1.0:1784935507.899697:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292066816:0@lo:400:kworker.0 00010000:00080000:1.0:1784935507.899710:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bce00 x1871640292067328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935507.899718:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292067328:0@lo:400:kworker.0 00000100:00100000:0.0:1784935507.901504:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292067072:0@lo:400:kworker.0 00000100:00100000:0.0:1784935507.901520:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292067584:0@lo:400:kworker.0 00010000:00010000:0.0:1784935508.078975:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935508.397211:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935508.397235:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292067840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935508.397304:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935508.397364:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292067840 00000100:00100000:2.0:1784935508.397372:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292067840 00000100:00100000:2.0:1784935508.397418:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784935508.397439:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292067840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784935508.397471:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935508.397518:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292067840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935508.397524:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1784935508.397565:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb5f80 x1871640292067840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935508.397584:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292067840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935508.397734:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935508.397746:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292067968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935508.397776:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935508.397857:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292067968 00000100:00100000:1.0:1784935508.397862:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292067968 00000100:00100000:1.0:1784935508.397900:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784935508.397907:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292067968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784935508.397918:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935508.397990:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292067968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935508.397996:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1784935508.398115:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574334000 x1871640292067968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935508.398128:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292067968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935508.656958:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935508.656995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935508.657065:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935508.657091:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935508.657116:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935508.657148:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273112320 00000100:00100000:0.0:1784935508.657156:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273112320 00000100:00100000:0.0:1784935508.657200:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 329 00000100:00100000:0.0:1784935508.657479:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273112320:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935508.657548:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273112320:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 75us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935508.657555:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 329 00000100:00100000:0.0:1784935508.657615:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273112448 00000100:00100000:0.0:1784935508.657620:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273112448 00000100:00100000:0.0:1784935508.657653:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273112704 00000100:00100000:0.0:1784935508.657656:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273112704 00000100:00100000:3.0:1784935508.657675:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273112576 00000100:00100000:0.0:1784935508.657675:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273112832 00000100:00100000:3.0:1784935508.657683:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273112576 00000100:00100000:0.0:1784935508.657683:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273112832 00000100:00100000:0.0:1784935508.657705:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 185 00000100:00100000:0.0:1784935508.657716:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273112448:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935508.657723:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 186 00000100:00100000:3.0:1784935508.657733:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273112704:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935508.657755:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273112448:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 40us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935508.657762:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 185 00000100:00100000:0.0:1784935508.657777:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 187 00000100:00100000:3.0:1784935508.657790:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273112704:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 55us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935508.657790:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273112832:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935508.657805:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 186 00000100:00100000:3.0:1784935508.657824:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 188 00000100:00100000:0.0:1784935508.657830:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273112832:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 42us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935508.657837:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273112576:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935508.657843:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 187 00000100:00100000:3.0:1784935508.657888:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273112576:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 55us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935508.657895:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 188 00000100:00080000:2.0:1784935508.658428:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784935508.658434:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935508.912836:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292068096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935508.912913:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935508.913094:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292068096 00000100:00100000:1.0:1784935508.913102:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292068096 00000100:00100000:1.0:1784935508.913155:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784935508.913164:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292068096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784935508.913197:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784935508.913249:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292068096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935508.913256:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784935508.913385:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292068096:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784935509.101168:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935510.125219:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935511.149314:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935511.469124:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935511.469158:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4581d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292068224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935511.469228:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935511.469525:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292068224 00000100:00100000:1.0:1784935511.469532:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292068224 00000100:00100000:1.0:1784935511.469602:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784935511.469612:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292068224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784935511.469644:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784935511.469702:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292068224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935511.469709:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784935511.469846:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4581d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292068224:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1784935512.027705:0:13538:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:25:10 (1784935510) === 00010000:00010000:1.0:1784935512.180530:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935512.257468:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935512.258439:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273112960 00000100:00100000:3.0:1784935512.258466:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273112960 00000100:00100000:3.0:1784935512.258578:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:3.0:1784935512.258591:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273112960:12345-192.168.203.28@tcp:41:mkdir.0 00000004:00000024:3.0:1784935512.258638:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:2.0:1784935512.258779:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935512.260090:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273112960:12345-192.168.203.28@tcp:41:mkdir.0 Request processed in 1494us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935512.260102:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:1.0:1784935512.262338:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935512.262970:0:6534:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273113088 00000100:00100000:0.0:1784935512.262979:0:6534:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273113088 00000100:00100000:0.0:1784935512.263072:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 2 00000100:00100000:0.0:1784935512.263082:0:6534:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:10472:x1871640273113088:12345-192.168.203.28@tcp:700:mkdir.0 00000100:00100000:0.0:1784935512.263171:0:6534:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:10472:x1871640273113088:12345-192.168.203.28@tcp:700:mkdir.0 Request processed in 90us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935512.263179:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 2 00000100:00100000:2.0:1784935512.265194:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935512.265282:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273113344 00000100:00100000:3.0:1784935512.265291:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273113344 00000100:00100000:3.0:1784935512.265342:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:3.0:1784935512.265350:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:10472:x1871640273113344:12345-192.168.203.28@tcp:36:mkdir.0 00010000:00010000:3.0:1784935512.265405:0:7797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935512.265488:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b16562 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a82f expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.265508:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d44432ed500) 00010000:00010000:3.0:1784935512.265531:0:7797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784935512.266026:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.266053:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.266064:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.266077:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.266085:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.266092:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267164:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267181:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267190:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784935512.267206:0:7797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bbe55625 reply state 00000000f7c46738 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267216:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267282:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d454742e200) 00010000:00010000:3.0:1784935512.267291:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784935512.267295:0:7797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784935512.267300:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784935512.267309:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267315:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267322:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267327:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540031000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935512.267332:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267339:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267348:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d454742e400) 00010000:00010000:3.0:1784935512.267350:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935512.267353:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267359:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784935512.267376:0:7797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bbe55625 reply state 00000000f7c46738 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267384:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.267399:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d454742ed00) 00010000:00010000:3.0:1784935512.267402:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784935512.267403:0:7797:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784935512.268086:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:10472:x1871640273113344:12345-192.168.203.28@tcp:36:mkdir.0 Request processed in 2729us (2893us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784935512.268096:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:2.0:1784935512.281989:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935512.282085:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273113472 00000100:00100000:1.0:1784935512.282095:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273113472 00000100:00100000:1.0:1784935512.282157:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:1.0:1784935512.282167:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+7:10473:x1871640273113472:12345-192.168.203.28@tcp:101:chmod.0 00010000:00010000:1.0:1784935512.282189:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935512.282213:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ca00/0x857e02f4e0b166d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a8c2 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.282294:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b166dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.282307:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b166dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.282482:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b166dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935512.282528:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784935512.282532:0:12375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935512.282577:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b166dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.282603:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ca00/0x857e02f4e0b166d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8c2 expref: 9 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.282622:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b166dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8c2 expref: 8 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.282631:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d454918d200) 00010000:00010000:1.0:1784935512.282634:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784935512.282637:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6d200, rc 0) 00000100:00100000:1.0:1784935512.283642:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+8:10473:x1871640273113472:12345-192.168.203.28@tcp:101:chmod.0 Request processed in 1468us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935512.283653:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:1.0:1784935512.287824:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935512.287909:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273113728 00000100:00100000:2.0:1784935512.287919:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273113728 00000100:00100000:2.0:1784935512.288000:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:2.0:1784935512.288012:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+8:10473:x1871640273113728:12345-192.168.203.28@tcp:36:chmod.0 00010000:00010000:2.0:1784935512.288066:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935512.288095:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b166dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8c2 expref: 8 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.288117:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d454918d200) 00010000:00010000:2.0:1784935512.288127:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935512.288163:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.288176:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.288186:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935512.288382:0:6525:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001bb9318e reply state 000000001d2c52e3 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.288395:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.288401:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145f00) 00010000:00010000:2.0:1784935512.288404:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1784935512.288406:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784935512.288414:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784935512.288727:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+9:10473:x1871640273113728:12345-192.168.203.28@tcp:36:chmod.0 Request processed in 716us (909us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784935512.288735:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:2.0:1784935512.317362:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935512.317438:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273113856 00000100:00100000:3.0:1784935512.317449:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273113856 00000100:00100000:3.0:1784935512.317513:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 26 00000100:00100000:3.0:1784935512.317524:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+9:10474:x1871640273113856:12345-192.168.203.28@tcp:101:chown.0 00010000:00010000:3.0:1784935512.317592:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935512.317614:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a8c9 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.317685:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b166f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.317700:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b166f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.317712:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b166f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935512.317753:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784935512.317758:0:7797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935512.317803:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b166f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.317830:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b166ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8c9 expref: 11 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.317878:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b166f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8c9 expref: 10 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.317888:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145f00) 00010000:00010000:3.0:1784935512.317891:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784935512.317894:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540030c00, rc 0) 00000100:00100000:2.0:1784935512.320402:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+10:10474:x1871640273113856:12345-192.168.203.28@tcp:101:chown.0 Request processed in 2867us (3036us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935512.320414:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 26 00000100:00100000:1.0:1784935512.326985:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935512.327082:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273113984 00000100:00100000:0.0:1784935512.327092:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273113984 00000100:00100000:0.0:1784935512.327185:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 27 00000100:00100000:0.0:1784935512.327196:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+10:10474:x1871640273113984:12345-192.168.203.28@tcp:101:chown.0 00010000:00010000:0.0:1784935512.327216:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935512.327236:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b166f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a8d0 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327320:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b166ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327336:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b166ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327348:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b166ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327373:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16706 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327383:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327389:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327469:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1670d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327478:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1670d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327484:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1670d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935512.327531:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784935512.327536:0:12375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935512.327557:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1670d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327582:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b166ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327589:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b166ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327596:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b166ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327612:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935512.327616:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b166ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327624:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b166ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327638:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145f00) 00010000:00010000:0.0:1784935512.327641:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935512.327645:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b166ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327652:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b166ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327666:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327671:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16706 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327677:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327681:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935512.327684:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327690:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16706 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327708:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d454742ed00) 00010000:00010000:0.0:1784935512.327710:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935512.327713:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16706 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327720:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16706 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327748:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b166f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8d0 expref: 12 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327761:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1670d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8d0 expref: 11 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.327769:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d454742e200) 00010000:00010000:0.0:1784935512.327772:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784935512.327774:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699c00, rc 0) 00000100:00100000:0.0:1784935512.327841:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+11:10474:x1871640273113984:12345-192.168.203.28@tcp:101:chown.0 Request processed in 647us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935512.327849:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 27 00000100:00100000:1.0:1784935512.333484:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935512.333582:0:6536:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273114112 00000100:00100000:0.0:1784935512.333591:0:6536:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273114112 00000100:00100000:0.0:1784935512.333646:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 6 00000100:00100000:0.0:1784935512.333657:0:6536:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:380c344d-145d-4a03-bcd4-797f2a6954a7+11:10474:x1871640273114112:12345-192.168.203.28@tcp:900:chown.0 00000100:00100000:0.0:1784935512.333761:0:6536:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:380c344d-145d-4a03-bcd4-797f2a6954a7+11:10474:x1871640273114112:12345-192.168.203.28@tcp:900:chown.0 Request processed in 106us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935512.333769:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 6 00000100:00100000:2.0:1784935512.339740:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935512.340468:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273114368 00000100:00100000:0.0:1784935512.340479:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273114368 00000100:00100000:0.0:1784935512.340662:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 28 00000100:00100000:0.0:1784935512.340673:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+11:10474:x1871640273114368:12345-192.168.203.28@tcp:36:chown.0 00010000:00010000:0.0:1784935512.341216:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935512.341244:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1670d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8d0 expref: 11 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.341263:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d454742e200) 00010000:00010000:0.0:1784935512.341267:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784935512.341293:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.341305:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.341437:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784935512.345912:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1784935512.346145:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346158:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346177:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346184:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540031800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935512.346187:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346195:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346211:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d454742ed00) 00010000:00010000:2.0:1784935512.346214:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935512.346217:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346224:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b166c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346584:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346591:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346598:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346603:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935512.346606:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346622:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346631:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d454742e200) 00010000:00010000:2.0:1784935512.346633:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935512.346636:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346642:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b166ce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346655:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346661:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346667:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346672:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935512.346674:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346680:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346686:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145f00) 00010000:00010000:2.0:1784935512.346688:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784935512.346690:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.346703:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b166e3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784935512.349295:0:6525:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000327de14c reply state 0000000085caa035 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.349333:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.349343:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d454742e200) 00010000:00010000:3.0:1784935512.349346:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784935512.349350:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784935512.349364:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1784935512.349460:0:6525:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784935512.349490:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+7:10474:x1871640273114368:12345-192.168.203.28@tcp:36:chown.0 Request processed in 8816us (9756us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784935512.349499:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 28 00010000:00010000:2.0:1784935512.350671:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.350685:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.350693:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.350699:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935512.350704:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.350711:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.350787:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d454742e200) 00010000:00010000:2.0:1784935512.350790:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784935512.350795:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.350801:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16714 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935512.374666:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935512.374806:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273114496 00000100:00100000:0.0:1784935512.374817:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273114496 00000100:00100000:0.0:1784935512.374891:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 29 00000100:00100000:0.0:1784935512.374911:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:10475:x1871640273114496:12345-192.168.203.28@tcp:101:touch.500 00010000:00010000:0.0:1784935512.374968:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935512.374990:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1671b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a8d7 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784935512.376445:0:7797:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1403us 00010000:00010000:1.0:1784935512.392701:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16722 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.392724:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.392735:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.392751:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16729 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.392758:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.392764:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.392892:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16730 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.392901:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.392909:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935512.392970:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784935512.392974:0:7797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935512.393013:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393038:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393044:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16722 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393051:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16722 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393057:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6d400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935512.393061:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16722 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393068:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16722 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393081:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145f00) 00010000:00010000:1.0:1784935512.393084:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935512.393088:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16722 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393095:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16722 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393107:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393113:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16729 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393119:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16729 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393131:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6cc00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935512.393134:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16729 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393141:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16729 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393150:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d44431e1200) 00010000:00010000:1.0:1784935512.393152:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935512.393154:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16729 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393160:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16729 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393198:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1671b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8d7 expref: 8 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393214:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8d7 expref: 7 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.393221:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d44431e1e00) 00010000:00010000:1.0:1784935512.393223:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784935512.393237:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6ce00, rc 0) 00000100:00100000:1.0:1784935512.393317:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:10475:x1871640273114496:12345-192.168.203.28@tcp:101:touch.500 Request processed in 18407us (18651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935512.393327:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 29 00000100:00100000:1.0:1784935512.401116:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935512.401274:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273114752 00000100:00100000:0.0:1784935512.401291:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273114752 00000100:00100000:0.0:1784935512.401351:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 30 00000100:00100000:0.0:1784935512.401361:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+7:10475:x1871640273114752:12345-192.168.203.28@tcp:101:touch.500 00010000:00010000:0.0:1784935512.401381:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935512.401403:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16737 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a8de expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.401521:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1673e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.401545:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1673e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.401557:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1673e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.401617:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.401624:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.401630:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784935512.402044:0:12375:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1784935512.402185:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1674c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402195:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1674c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402213:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1674c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402246:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1673e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402253:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1673e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402259:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1673e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402264:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935512.402268:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1673e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402275:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1673e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402285:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d44431e1e00) 00010000:00010000:0.0:1784935512.402288:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935512.402291:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1673e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402296:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1673e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784935512.402308:0:12375:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009bcd4eec reply state 000000006fc1c33a transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402317:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402330:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc5e41dd7 (ffff8d44432e9b00) 00010000:00010000:0.0:1784935512.402332:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784935512.402334:0:12375:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784935512.402364:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16737 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8de expref: 10 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402378:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1674c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8de expref: 9 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935512.402385:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d44432e9800) 00010000:00010000:0.0:1784935512.402387:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935512.402390:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698c00, rc 0) 00000100:00100000:0.0:1784935512.402455:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+10:10475:x1871640273114752:12345-192.168.203.28@tcp:101:touch.500 Request processed in 1094us (1348us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784935512.402464:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 30 00000100:00100000:3.0:1784935512.408152:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935512.408647:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273115008 00000100:00100000:2.0:1784935512.408657:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273115008 00000100:00100000:2.0:1784935512.408708:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 31 00000100:00100000:2.0:1784935512.408733:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+10:10475:x1871640273115008:12345-192.168.203.28@tcp:36:touch.500 00010000:00010000:2.0:1784935512.408794:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935512.408822:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1674c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8de expref: 10 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.408840:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d44432e9800) 00010000:00010000:2.0:1784935512.408849:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935512.408907:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.408923:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.408954:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935512.409053:0:6525:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000007929bda reply state 00000000be71c584 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.409065:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.409071:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d457d145c00) 00010000:00010000:2.0:1784935512.409073:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784935512.409075:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784935512.409169:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+11:10475:x1871640273115008:12345-192.168.203.28@tcp:36:touch.500 Request processed in 438us (1026us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784935512.409176:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 31 00000100:00100000:2.0:1784935512.412502:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935512.412587:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273115136 00000100:00100000:1.0:1784935512.412597:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273115136 00000100:00100000:1.0:1784935512.412656:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 32 00000100:00100000:1.0:1784935512.412666:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+11:10475:x1871640273115136:12345-192.168.203.28@tcp:101:touch.500 00010000:00010000:1.0:1784935512.412691:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935512.412711:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16761 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a8e5 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.412762:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16761 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8e5 expref: 12 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.412776:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16761 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8e5 expref: 12 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.412796:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d457d145c00) 00010000:00010000:1.0:1784935512.412799:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784935512.412803:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6cc00, rc 0) 00000100:00100000:1.0:1784935512.412870:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+12:10475:x1871640273115136:12345-192.168.203.28@tcp:101:touch.500 Request processed in 198us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935512.412878:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 32 00000100:00100000:0.0:1784935512.416697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935512.416774:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273115264 00000100:00100000:1.0:1784935512.416786:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273115264 00000100:00100000:1.0:1784935512.416835:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:1.0:1784935512.416844:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1871640273115264:12345-192.168.203.28@tcp:8:touch.500 00010000:00080000:1.0:1784935512.416879:0:8441:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp t0 exp 0000000000000000 cur 331 last 0 00000020:00000080:1.0:1784935512.416965:0:8441:0:(genops.c:1406:class_connect()) connect: client 380c344d-145d-4a03-bcd4-797f2a6954a7, cookie 0x857e02f4e0b16768 00002000:00100000:1.0:1784935512.416980:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 380c344d-145d-4a03-bcd4-797f2a6954a7/ffff8d444285e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784935512.417009:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784935512.417075:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784935512.417103:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8d444285b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935512.417160:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2390:x1871640273115264:12345-192.168.203.28@tcp:8:touch.500 Request processed in 316us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935512.417168:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:3.0:1784935512.419443:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935512.419612:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273115392 00000100:00100000:0.0:1784935512.419621:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273115392 00000100:00100000:0.0:1784935512.419759:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:0.0:1784935512.419776:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:0:x1871640273115392:12345-192.168.203.28@tcp:2:touch.500 00000100:00080000:2.0:1784935512.420126:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1784935512.433853:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1784935512.433869:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000100:00100000:0.0:1784935512.434112:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:0:x1871640273115392:12345-192.168.203.28@tcp:2:touch.500 Request processed in 14332us (14671us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784935512.434123:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:2.0:1784935512.437239:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935512.437553:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273115648 00000100:00100000:1.0:1784935512.437562:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273115648 00000100:00100000:1.0:1784935512.437696:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 2 00000100:00100000:1.0:1784935512.437821:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+12:10475:x1871640273115648:12345-192.168.203.28@tcp:35:touch.500 00000100:00100000:1.0:1784935512.438199:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+13:10475:x1871640273115648:12345-192.168.203.28@tcp:35:touch.500 Request processed in 494us (969us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784935512.438207:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 2 00000100:00100000:1.0:1784935512.457346:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935512.457766:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273115776 00000100:00100000:3.0:1784935512.457777:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273115776 00000100:00100000:3.0:1784935512.457890:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 33 00000100:00100000:3.0:1784935512.457901:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+13:10476:x1871640273115776:12345-192.168.203.28@tcp:101:rm.0 00010000:00010000:3.0:1784935512.457976:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935512.457999:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b1676f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a8ec expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.458068:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b16776 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.458082:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b16776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.458094:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b16776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935512.458135:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784935512.458139:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935512.458172:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b16776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.458198:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b1676f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8ec expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.458215:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b16776 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8ec expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.458223:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d44431e1e00) 00010000:00010000:3.0:1784935512.458226:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784935512.458229:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540030e00, rc 0) 00000100:00100000:3.0:1784935512.458307:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+14:10476:x1871640273115776:12345-192.168.203.28@tcp:101:rm.0 Request processed in 407us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935512.458321:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 33 00000100:00100000:3.0:1784935512.462646:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935512.462784:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273116032 00000100:00100000:1.0:1784935512.462794:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273116032 00000100:00100000:1.0:1784935512.462905:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 34 00000100:00100000:1.0:1784935512.462916:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+14:10476:x1871640273116032:12345-192.168.203.28@tcp:101:rm.0 00010000:00010000:1.0:1784935512.462973:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935512.462992:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b1677d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a8f3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935512.463086:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784935512.463222:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b1677d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8f3 expref: 16 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.463247:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145f00) 00010000:00010000:1.0:1784935512.463250:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784935512.463265:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b1677d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8f3 expref: 16 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.463280:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6d200, rc 0) 00000100:00100000:1.0:1784935512.463358:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+15:10476:x1871640273116032:12345-192.168.203.28@tcp:101:rm.0 Request processed in 444us (722us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1784935512.463365:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 34 00000100:00100000:1.0:1784935512.470626:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935512.470818:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273116160 00000100:00100000:0.0:1784935512.470829:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273116160 00000100:00100000:0.0:1784935512.470884:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 3 00000100:00100000:0.0:1784935512.470909:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+15:10476:x1871640273116160:12345-192.168.203.28@tcp:37:rm.0 00000100:00100000:0.0:1784935512.474633:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+15:10476:x1871640273116160:12345-192.168.203.28@tcp:37:rm.0 Request processed in 3714us (4004us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935512.474649:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 3 00000100:00100000:3.0:1784935512.477879:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935512.478077:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273116416 00000100:00100000:1.0:1784935512.478086:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273116416 00000100:00100000:1.0:1784935512.478134:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 4 00000100:00100000:1.0:1784935512.478149:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+15:10476:x1871640273116416:12345-192.168.203.28@tcp:35:rm.0 00000100:00100000:1.0:1784935512.478457:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+16:10476:x1871640273116416:12345-192.168.203.28@tcp:35:rm.0 Request processed in 306us (583us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1784935512.478465:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 4 00000100:00100000:1.0:1784935512.481213:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935512.481721:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273116672 00000100:00100000:0.0:1784935512.481733:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273116672 00000100:00100000:2.0:1784935512.481878:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 35 00000100:00100000:2.0:1784935512.481893:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+16:10476:x1871640273116672:12345-192.168.203.28@tcp:101:rm.0 00010000:00010000:2.0:1784935512.481923:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935512.482076:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b1678b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a8fa expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.482183:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b16792 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.482198:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b16792 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.482209:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b16792 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935512.482221:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784935512.482435:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b1678b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8fa expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.482456:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b16792 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8fa expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.482465:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d44431e1e00) 00010000:00010000:2.0:1784935512.482532:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784935512.482651:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d301e00, rc 0) 00000100:00100000:2.0:1784935512.482716:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+18:10476:x1871640273116672:12345-192.168.203.28@tcp:101:rm.0 Request processed in 826us (1512us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784935512.482723:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 35 00000100:00100000:3.0:1784935512.490743:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935512.490814:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273116800 00000100:00100000:2.0:1784935512.490824:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273116800 00000100:00100000:2.0:1784935512.490924:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 36 00000100:00100000:2.0:1784935512.490955:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+18:10476:x1871640273116800:12345-192.168.203.28@tcp:41:rm.0 00000004:00000024:2.0:1784935512.491018:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1784935512.491098:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+18:10476:x1871640273116800:12345-192.168.203.28@tcp:41:rm.0 Request processed in 145us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935512.491105:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 36 00000100:00100000:2.0:1784935512.493493:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935512.497750:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273116928 00000100:00100000:1.0:1784935512.497765:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273116928 00000100:00100000:1.0:1784935512.497918:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 37 00000100:00100000:1.0:1784935512.497955:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+18:10476:x1871640273116928:12345-192.168.203.28@tcp:101:rm.0 00010000:00010000:1.0:1784935512.497985:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935512.498007:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c600/0x857e02f4e0b167a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a901 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498087:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c200/0x857e02f4e0b167a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498102:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c200/0x857e02f4e0b167a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498113:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c200/0x857e02f4e0b167a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498124:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b167ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498131:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b167ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498138:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b167ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498731:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b167b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498744:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b167b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498752:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b167b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935512.498784:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1784935512.498788:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935512.498872:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b167b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498899:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b167b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498909:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c200/0x857e02f4e0b167a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498915:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c200/0x857e02f4e0b167a7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498922:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c200/0x857e02f4e0b167a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.498972:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6c200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935512.499032:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c200/0x857e02f4e0b167a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499041:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c200/0x857e02f4e0b167a7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499052:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d44431e1e00) 00010000:00010000:1.0:1784935512.499054:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935512.499058:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c200/0x857e02f4e0b167a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499064:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c200/0x857e02f4e0b167a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499079:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b167ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499084:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b167ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499096:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b167ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499101:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6de00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935512.499103:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b167ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499109:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b167ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499117:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc5e41dd7 (ffff8d44432e9b00) 00010000:00010000:1.0:1784935512.499120:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935512.499122:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b167ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499127:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b167ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499223:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c600/0x857e02f4e0b167a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a901 expref: 20 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499239:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b167b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a901 expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935512.499246:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d457d145c00) 00010000:00010000:1.0:1784935512.499249:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935512.499251:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6d200, rc 0) 00000100:00100000:1.0:1784935512.500084:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+19:10476:x1871640273116928:12345-192.168.203.28@tcp:101:rm.0 Request processed in 2150us (6594us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935512.500105:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 37 00000100:00100000:1.0:1784935512.507211:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935512.507451:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273117184 00000100:00100000:2.0:1784935512.507462:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273117184 00000100:00100000:2.0:1784935512.507521:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 38 00000100:00100000:2.0:1784935512.507532:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+19:10476:x1871640273117184:12345-192.168.203.28@tcp:36:rm.0 00010000:00010000:2.0:1784935512.507649:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784935512.507674:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b167b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a901 expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.507874:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16761 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8e5 expref: 18 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.507891:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d457d145c00) 00010000:00010000:2.0:1784935512.507905:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b16776 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8ec expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.507915:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d44431e1e00) 00010000:00010000:2.0:1784935512.507919:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935512.509340:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b167bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.509374:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b167bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.509500:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b167bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.509516:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.509524:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.509531:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.509874:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b167ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.509884:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b167ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.509892:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b167ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784935512.510608:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1784935512.510623:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331760694283ns, next at 332760691960ns, rc = 0 00010000:00010000:2.0:1784935512.510674:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b167d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.510685:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b167d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511176:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b167d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511187:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b167d1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511194:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b167d1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511200:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b167d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511334:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784935512.511357:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b167ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511363:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b167ca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511369:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b167ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511375:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935512.511379:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b167ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511397:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b167ca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511409:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d457d145c00) 00010000:00010000:2.0:1784935512.511412:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784935512.511426:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b167ca lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511432:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b167ca lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511451:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b167bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511457:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b167bc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511462:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b167bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511467:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935512.511470:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b167bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511476:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b167bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511485:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d44431e1e00) 00010000:00010000:2.0:1784935512.511487:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935512.511490:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b167bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511496:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b167bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935512.511506:0:6525:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096cda964 reply state 00000000ee508289 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511529:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.511545:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc5e41dd7 (ffff8d44432e9b00) 00010000:00010000:2.0:1784935512.511547:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784935512.511550:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784935512.511640:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+18:10476:x1871640273117184:12345-192.168.203.28@tcp:36:rm.0 Request processed in 4106us (4434us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784935512.511648:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 38 00010000:00010000:3.0:1784935512.512114:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935512.512121:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b167d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.512130:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300800 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935512.512133:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b167d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.512140:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b167d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.512152:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d457d145c00) 00010000:00010000:3.0:1784935512.512155:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784935512.512158:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b167d1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935512.512164:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b167d1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.512308:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935512.512311:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935512.512312:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935512.517805:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935512.517862:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273117440 00000100:00100000:2.0:1784935512.517872:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273117440 00000100:00100000:2.0:1784935512.518073:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 5 00000100:00100000:2.0:1784935512.518087:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+18:10476:x1871640273117440:12345-192.168.203.28@tcp:35:rm.0 00000100:00100000:2.0:1784935512.518327:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+19:10476:x1871640273117440:12345-192.168.203.28@tcp:35:rm.0 Request processed in 243us (530us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784935512.518335:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 5 00000100:00100000:0.0:1784935512.520638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935512.520777:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273117696 00000100:00100000:2.0:1784935512.520787:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273117696 00000100:00100000:2.0:1784935512.520881:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 39 00000100:00100000:2.0:1784935512.520892:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+19:10476:x1871640273117696:12345-192.168.203.28@tcp:36:rm.0 00010000:00010000:2.0:1784935512.520975:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784935512.521000:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b16792 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8fa expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521052:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16730 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8d7 expref: 18 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521065:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d44431e1e00) 00010000:00010000:2.0:1784935512.521080:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b166f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8c9 expref: 17 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521089:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145f00) 00010000:00010000:2.0:1784935512.521096:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935512.521119:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b167d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521132:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b167d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521142:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b167d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521154:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521161:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521167:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521268:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b167e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521285:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b167e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521293:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b167e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935512.521526:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784935512.521540:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b167e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521560:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b167e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521576:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b167e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521582:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935512.521587:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b167e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521595:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b167e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521604:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d457d145300) 00010000:00010000:2.0:1784935512.521606:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784935512.521610:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b167e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521616:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b167e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521632:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b167d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521645:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b167d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521651:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b167d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521656:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935512.521659:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b167d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521665:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b167d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521674:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145000) 00010000:00010000:2.0:1784935512.521676:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935512.521679:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b167d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521684:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b167d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935512.521705:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f9b442c reply state 000000000c289af5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521715:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935512.521721:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d457d145e00) 00010000:00010000:2.0:1784935512.521724:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784935512.521726:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784935512.521808:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+18:10476:x1871640273117696:12345-192.168.203.28@tcp:36:rm.0 Request processed in 917us (1178us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784935512.521822:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 39 00000100:00100000:3.0:1784935513.005128:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292068352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935513.005209:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935513.005259:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292068608:0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.005292:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292068864:0@lo:400:kworker.0 00000100:00100000:2.0:1784935513.005300:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935513.005325:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292069120:0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.005332:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935513.005359:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292069376:0@lo:400:kworker.0 00000100:00100000:2.0:1784935513.005360:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935513.005397:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292069632:0@lo:400:kworker.0 00000100:00100000:1.0:1784935513.005457:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292068736:0@lo:400:kworker.0 00000100:00100000:0.0:1784935513.005474:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292068480:0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.006971:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935513.007090:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292069888:0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.007143:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935513.007224:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292068352 00000100:00100000:3.0:1784935513.007232:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292068352 00000100:00100000:3.0:1784935513.007363:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784935513.007373:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292068352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784935513.007417:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935513.007464:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292068352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935513.007471:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1784935513.007495:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784935513.007522:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566f36d80 x1871640292068352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935513.007541:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292068352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935513.007587:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292068608 00000100:00100000:3.0:1784935513.007592:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292068608 00000100:00100000:3.0:1784935513.007618:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292068864 00000100:00100000:3.0:1784935513.007621:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292068864 00000100:00100000:3.0:1784935513.007636:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292069120 00000100:00100000:3.0:1784935513.007639:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292069120 00000100:00080000:3.0:1784935513.007652:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935513.007667:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1784935513.007673:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292068608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.007712:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292068608:12345-0@lo:400:kworker.0 Request processed in 39us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935513.007718:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1784935513.007728:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1784935513.007734:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292068864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.007779:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292068864:12345-0@lo:400:kworker.0 Request processed in 45us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935513.007786:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1784935513.007809:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292068864:0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.007826:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784935513.007833:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292069120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.007866:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292069120:12345-0@lo:400:kworker.0 Request processed in 34us (2509us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935513.007872:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784935513.007914:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292069376 00000100:00100000:3.0:1784935513.007919:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292069376 00000100:00100000:2.0:1784935513.007924:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935513.007984:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292070144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784935513.008010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935513.008036:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292068608:0@lo:400:kworker.0 00000100:00100000:2.0:1784935513.008048:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292069120:0@lo:400:kworker.0 00000100:00100000:2.0:1784935513.008071:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292070144 00000100:00100000:2.0:1784935513.008075:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292070144 00000100:00100000:2.0:1784935513.008103:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784935513.008110:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292070144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784935513.008122:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935513.008153:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292070144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935513.008160:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1784935513.008183:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434bd880 x1871640292070144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935513.008197:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292070144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784935513.008215:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292069632 00000100:00100000:2.0:1784935513.008239:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292069632 00000100:00100000:2.0:1784935513.008267:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1784935513.008273:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292069632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935513.008307:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292069632:12345-0@lo:400:kworker.0 Request processed in 34us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935513.008313:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1784935513.008338:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292069632:0@lo:400:kworker.0 00000100:00080000:2.0:1784935513.008370:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784935513.008373:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784935513.008375:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935513.009172:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292069888 00000100:00100000:3.0:1784935513.009181:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292069888 00000100:00100000:3.0:1784935513.009219:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784935513.009228:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292069376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.010100:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292069376:12345-0@lo:400:kworker.0 Request processed in 870us (3132us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935513.010110:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784935513.010132:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784935513.010139:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292069888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.010179:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292069888:12345-0@lo:400:kworker.0 Request processed in 41us (3035us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935513.010184:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1784935513.010232:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570596300 x1871640292069376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935513.010266:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292069376:0@lo:400:kworker.0 00010000:00080000:3.0:1784935513.010538:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570597100 x1871640292069888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935513.010548:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292069888:0@lo:400:kworker.0 00000100:00100000:1.0:1784935513.017963:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935513.018055:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292069248:0@lo:400:kworker.0 00000100:00100000:1.0:1784935513.018102:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935513.018125:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292069760:0@lo:400:kworker.0 00000100:00100000:1.0:1784935513.018147:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935513.018196:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292069248 00000100:00100000:1.0:1784935513.018204:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292069248 00000100:00100000:1.0:1784935513.018254:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292069760 00000100:00100000:1.0:1784935513.018257:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292069760 00000100:00100000:1.0:1784935513.019496:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784935513.019518:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292069248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935513.019614:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292069248:12345-0@lo:400:kworker.0 Request processed in 107us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935513.019621:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784935513.019646:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1784935513.019652:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292069760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935513.019685:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292069760:12345-0@lo:400:kworker.0 Request processed in 34us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935513.019690:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1784935513.019712:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784935513.019753:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570595c00 x1871640292069248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935513.019786:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292069248:0@lo:400:kworker.0 00010000:00080000:1.0:1784935513.019801:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570594000 x1871640292069760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935513.019810:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292069760:0@lo:400:kworker.0 00000100:00100000:2.0:1784935513.019973:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292068736 00000100:00100000:2.0:1784935513.019989:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292068736 00000100:00100000:2.0:1784935513.020031:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784935513.020038:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292068736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935513.020092:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292068736:12345-0@lo:400:kworker.0 Request processed in 53us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935513.020098:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784935513.020169:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292068736:0@lo:400:kworker.0 00000100:00100000:0.0:1784935513.026339:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935513.026626:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292068480 00000100:00100000:1.0:1784935513.026637:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292068480 00000100:00100000:0.0:1784935513.026669:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292068992:0@lo:400:kworker.0 00000100:00100000:1.0:1784935513.026695:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1784935513.026705:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292068480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935513.026771:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292068480:12345-0@lo:400:kworker.0 Request processed in 68us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935513.026779:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1784935513.026791:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935513.026883:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292068992 00000100:00100000:3.0:1784935513.026887:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292068992 00000100:00100000:3.0:1784935513.026942:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784935513.026946:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292069504:0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.026952:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292068992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935513.031450:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292068992:12345-0@lo:400:kworker.0 Request processed in 4495us (4655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935513.031465:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784935513.031717:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935513.031769:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292070016:0@lo:400:kworker.0 00000100:00100000:0.0:1784935513.031819:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935513.031876:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292068480:0@lo:400:kworker.0 00000100:00100000:0.0:1784935513.031890:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292068992:0@lo:400:kworker.0 00000100:00100000:2.0:1784935513.032396:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292069504 00000100:00100000:2.0:1784935513.032405:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292069504 00000100:00100000:2.0:1784935513.032478:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292070016 00000100:00100000:2.0:1784935513.032482:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292070016 00000100:00100000:2.0:1784935513.032506:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784935513.032516:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292069504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935513.032588:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292069504:12345-0@lo:400:kworker.0 Request processed in 74us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935513.032595:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784935513.032611:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784935513.032618:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292070016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935513.032663:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292070016:12345-0@lo:400:kworker.0 Request processed in 46us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935513.032669:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1784935513.032749:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784935513.033009:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570596a00 x1871640292069504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935513.033022:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292069504:0@lo:400:kworker.0 00010000:00080000:0.0:1784935513.033033:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570596d80 x1871640292070016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935513.033053:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292070016:0@lo:400:kworker.0 00010000:00010000:1.0:1784935513.198065:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935513.517327:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935513.517351:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292070272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935513.517415:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935513.517476:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292070272 00000100:00100000:2.0:1784935513.517484:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292070272 00000100:00100000:2.0:1784935513.517527:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784935513.517536:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292070272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784935513.517558:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935513.517615:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292070272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935513.517621:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1784935513.518280:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44423cd880 x1871640292070272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935513.518300:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292070272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935513.524207:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935513.524230:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292070400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935513.524301:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935513.524358:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292070400 00000100:00100000:1.0:1784935513.524365:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292070400 00000100:00100000:1.0:1784935513.524409:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784935513.524418:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292070400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784935513.524440:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935513.524499:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292070400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935513.524507:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1784935513.524556:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443598000 x1871640292070400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935513.524599:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292070400:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1784935513.524637:0:8985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332774708224ns, next at 333774706055ns, rc = 0 00000100:00100000:3.0:1784935513.769289:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935513.769333:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935513.769367:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935513.769405:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935513.769429:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935513.769451:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935513.769478:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273117824 00000100:00100000:3.0:1784935513.769487:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273117824 00000100:00100000:3.0:1784935513.769533:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 331 00000100:00100000:3.0:1784935513.769542:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2393:x1871640273117824:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935513.769614:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2393:x1871640273117824:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935513.769637:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 331 00000100:00100000:3.0:1784935513.769671:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273117952 00000100:00100000:3.0:1784935513.769675:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273117952 00000100:00100000:0.0:1784935513.769697:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273118464 00000100:00100000:0.0:1784935513.769704:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273118464 00000100:00100000:3.0:1784935513.769706:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273118080 00000100:00100000:3.0:1784935513.769711:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273118080 00000100:00100000:3.0:1784935513.769739:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273118336 00000100:00100000:3.0:1784935513.769742:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273118336 00000100:00100000:0.0:1784935513.769768:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 195 00000100:00100000:0.0:1784935513.769778:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+18:2393:x1871640273117952:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935513.769802:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273118208 00000100:00100000:1.0:1784935513.769808:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273118208 00000100:00100000:0.0:1784935513.769822:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+18:2393:x1871640273117952:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 45us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935513.769891:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 76 00000100:00100000:1.0:1784935513.769899:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273118208:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935513.769967:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273118208:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 69us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935513.769974:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 76 00000100:00100000:3.0:1784935513.770845:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 196 00000100:00100000:3.0:1784935513.770858:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273118080:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935513.770899:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273118080:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 46us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935513.770906:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 196 00000100:00100000:3.0:1784935513.770921:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 197 00000100:00080000:1.0:1784935513.771231:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935513.771238:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935513.771289:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273118464:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935513.771318:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273118464:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 391us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935513.771325:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 197 00000100:00100000:3.0:1784935513.771340:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 198 00000100:00100000:3.0:1784935513.771347:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273118336:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935513.771372:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273118336:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 25us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935513.771377:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 198 00000100:00100000:0.0:1784935513.773182:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 195 00000100:00100000:0.0:1784935514.029184:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784935514.029218:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292070528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935514.029288:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935514.029452:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292070528 00000100:00100000:1.0:1784935514.029459:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292070528 00000100:00100000:1.0:1784935514.029508:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784935514.029518:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292070528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784935514.029569:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784935514.029614:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292070528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935514.029620:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784935514.029867:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292070528:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784935514.222099:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935515.248965:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935516.271520:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784935516.375699:0:13686:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1784935516.591620:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292070656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935516.591695:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935516.591767:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292070656 00000100:00100000:2.0:1784935516.591776:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292070656 00000100:00100000:2.0:1784935516.591823:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784935516.591831:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292070656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784935516.591869:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784935516.591956:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292070656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935516.591962:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784935516.592024:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292070656:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784935517.293067:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784935517.431264:0:13734:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8485ca80 20000000:00000080:1.0:1784935517.431280:0:13734:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d44434ad400 uarg=0000000000000000 20000000:01000000:1.0:1784935517.431319:0:13734:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1784935517.431325:0:13734:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1784935517.431340:0:13734:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1784935517.432581:0:13735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1784935517.433492:0:13734:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1784935517.437713:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1784935517.437761:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1784935517.437774:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1784935517.437788:0:13734:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784935517.437805:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.437822:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4541529400/0x857e02f4e0b16681 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1667a expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.437830:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4442a6d800/0x857e02f4e0b1668f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16688 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.437837:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4541529000/0x857e02f4e0b1669d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16696 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.437844:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b166ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b166a4 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.437852:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b166b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8b4 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.437859:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4541528200/0x857e02f4e0b166b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8bb expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.437882:0:13734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.437916:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4541528200/0x857e02f4e0b166b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8bb expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.437959:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4541528200/0x857e02f4e0b166b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8bb expref: 12 pid: 6520 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935517.437973:0:13734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292070784:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935517.438057:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b166b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8b4 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.438066:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b166b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8b4 expref: 12 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935517.438074:0:13734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44423cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292070912:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935517.438097:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b166ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b166a4 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.438105:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b166ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b166a4 expref: 23 pid: 6520 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935517.438113:0:13734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570596d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292071040:0@lo:104: 00000100:00100000:2.0:1784935517.438147:0:13734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784935517.438170:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4541529000/0x857e02f4e0b1669d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16696 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.438188:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4541529000/0x857e02f4e0b1669d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16696 expref: 23 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935517.438196:0:13734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570596a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292071168:0@lo:104: 00010000:00010000:2.0:1784935517.438217:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4442a6d800/0x857e02f4e0b1668f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b16688 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.438224:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4442a6d800/0x857e02f4e0b1668f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b16688 expref: 23 pid: 6517 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935517.438232:0:13734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292071296:0@lo:104: 00010000:00010000:2.0:1784935517.438247:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4541529400/0x857e02f4e0b16681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b1667a expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.438254:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d4541529400/0x857e02f4e0b16681 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b1667a expref: 23 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935517.438261:0:13734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570595c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292071424:0@lo:104: 00000100:00100000:2.0:1784935517.438273:0:13734:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1bbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935517.438997:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784935517.439020:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935517.439041:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935517.439048:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935517.439055:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292071040 00000100:00100000:0.0:1784935517.439061:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292071040 00000100:00100000:0.0:1784935517.439092:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292071168 00000100:00100000:0.0:1784935517.439094:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292071168 00000100:00100000:0.0:1784935517.439102:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292071296 00000100:00100000:0.0:1784935517.439104:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292071296 00000100:00100000:0.0:1784935517.439110:0:6508:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292071424 00000100:00100000:0.0:1784935517.439112:0:6508:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292071424 00000100:00100000:0.0:1784935517.439123:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784935517.439129:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457428f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:13734:x1871640292071040:12345-0@lo:104: 00010000:00010000:0.0:1784935517.439150:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935517.439197:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935517.439202:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457428f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+6:13734:x1871640292071040:12345-0@lo:104: Request processed in 74us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935517.439209:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784935517.439240:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784935517.439245:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:13734:x1871640292071168:12345-0@lo:104: 00010000:00010000:0.0:1784935517.439251:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935517.439273:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784935517.439277:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+5:13734:x1871640292071168:12345-0@lo:104: Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935517.439282:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784935517.439290:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784935517.439295:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:13734:x1871640292071296:12345-0@lo:104: 00010000:00010000:0.0:1784935517.439301:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935517.439319:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784935517.439323:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+4:13734:x1871640292071296:12345-0@lo:104: Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935517.439328:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784935517.439336:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784935517.439340:0:6508:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442954380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:13734:x1871640292071424:12345-0@lo:104: 00010000:00010000:0.0:1784935517.439351:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935517.439371:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1784935517.439375:0:6508:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442954380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+3:13734:x1871640292071424:12345-0@lo:104: Request processed in 35us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935517.439380:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784935517.439531:0:13734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570596d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292071040:0@lo:104: 00000100:00100000:2.0:1784935517.439550:0:13734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570596a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292071168:0@lo:104: 00000100:00100000:2.0:1784935517.439556:0:13734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292071296:0@lo:104: 00000100:00100000:2.0:1784935517.439562:0:13734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570595c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292071424:0@lo:104: 00010000:00010000:1.0:1784935517.440215:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784935517.440224:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440232:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6d600 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935517.440236:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440245:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935517.440252:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935517.440258:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784935517.440288:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440294:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935517.440312:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440319:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d600/0x857e02f4e0b166a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b166ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440331:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784935517.440333:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440350:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d45413a0800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935517.440353:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440360:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935517.440365:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935517.440371:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784935517.440381:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440386:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935517.440399:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440406:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d45413a0800/0x857e02f4e0b16696 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1669d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440414:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784935517.440417:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440422:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300400 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935517.440425:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440440:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935517.440446:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935517.440451:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784935517.440461:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440465:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935517.440470:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440476:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d300400/0x857e02f4e0b16688 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1668f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440486:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784935517.440489:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440495:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d45413a0400 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935517.440497:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440503:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935517.440509:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935517.440519:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784935517.440528:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440533:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935517.440552:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440558:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d45413a0400/0x857e02f4e0b1667a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b16681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.440571:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935517.440572:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935517.440574:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935517.440749:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935517.440794:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292071552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935517.440842:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935517.440889:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784935517.440895:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292071936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935517.440916:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935517.440970:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292071680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935517.440992:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935517.441008:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935517.441013:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292071808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935517.441033:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935517.441060:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292071552 00000100:00100000:1.0:1784935517.441066:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292071552 00000100:00100000:3.0:1784935517.441079:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292071936 00000100:00100000:3.0:1784935517.441089:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292071936 00010000:00010000:1.0:1784935517.441091:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b166ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b166a4 expref: 24 pid: 6520 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.441102:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4541529400/0x857e02f4e0b16681 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1667a expref: 25 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935517.441115:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292071680 00000100:00100000:1.0:1784935517.441117:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292071680 00000100:00100000:3.0:1784935517.441126:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292071808 00010000:00010000:1.0:1784935517.441127:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4541529000/0x857e02f4e0b1669d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16696 expref: 26 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935517.441128:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292071808 00010000:00010000:3.0:1784935517.441136:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4442a6d800/0x857e02f4e0b1668f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16688 expref: 27 pid: 6517 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935517.441139:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784935517.441146:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784935517.441146:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+27:3650:x1871640292071552:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784935517.441150:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+27:3650:x1871640292071936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935517.441158:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935517.441158:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935517.441163:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b166ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b166a4 expref: 27 pid: 6520 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.441164:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4541529400/0x857e02f4e0b16681 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1667a expref: 27 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.441173:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b166ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b166a4 expref: 27 pid: 6520 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.441316:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4541529400/0x857e02f4e0b16681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b1667a expref: 27 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.441330:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541529400/0x857e02f4e0b16681 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b1667a expref: 27 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.441343:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935517.441387:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+26:3650:x1871640292071936:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935517.441393:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784935517.441408:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784935517.441414:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+25:3651:x1871640292071680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935517.441422:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935517.441426:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4541529000/0x857e02f4e0b1669d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16696 expref: 25 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.441443:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4541529000/0x857e02f4e0b1669d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16696 expref: 25 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.441454:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541529000/0x857e02f4e0b1669d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16696 expref: 25 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.441463:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935517.441498:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292071680:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935517.441505:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784935517.441518:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784935517.441524:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:3651:x1871640292071808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935517.441531:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935517.441545:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4442a6d800/0x857e02f4e0b1668f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b16688 expref: 23 pid: 6517 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.441553:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4442a6d800/0x857e02f4e0b1668f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b16688 expref: 23 pid: 6517 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.441562:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4442a6d800/0x857e02f4e0b1668f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b16688 expref: 23 pid: 6517 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.441570:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935517.441593:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:3651:x1871640292071808:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935517.441599:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784935517.441783:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292071936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935517.441783:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292071808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935517.441791:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292071680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784935517.441871:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b166ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b166a4 expref: 21 pid: 6520 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.441880:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935517.441921:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3650:x1871640292071552:12345-0@lo:103:ldlm_bl.0 Request processed in 775us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935517.441969:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292071552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935517.442201:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784935517.443601:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935517.443694:0:13734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292070784:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935517.443823:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273118592 00000100:00100000:3.0:1784935517.443832:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273118592 00010000:00010000:3.0:1784935517.443889:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4541528200/0x857e02f4e0b166b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8bb expref: 13 pid: 6520 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935517.443945:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:3.0:1784935517.443954:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273118592:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935517.444096:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935517.444103:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4541528200/0x857e02f4e0b166b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8bb expref: 13 pid: 6520 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.444114:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4541528200/0x857e02f4e0b166b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8bb expref: 13 pid: 6520 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.444130:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541528200/0x857e02f4e0b166b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8bb expref: 13 pid: 6520 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.444146:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935517.444199:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:2394:x1871640273118592:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 246us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935517.444208:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 50 00000004:00080000:0.0:1784935517.446087:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1784935517.446120:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1784935517.446128:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1784935517.446290:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446303:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446311:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446317:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935517.446321:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446329:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446345:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc5e41dd7 (ffff8d44432e9b00) 00010000:00010000:2.0:1784935517.446349:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935517.446354:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446361:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16745 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446380:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446386:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446410:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446415:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935517.446419:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446425:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446434:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d457d145c00) 00010000:00010000:2.0:1784935517.446436:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935517.446439:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446445:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b1675a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446466:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446472:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446477:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446481:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935517.446484:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446499:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446506:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc5e41dd7 (ffff8d44432e9b00) 00010000:00010000:2.0:1784935517.446508:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935517.446511:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446516:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b167c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xc5e41dd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446529:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446547:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446553:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446558:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935517.446561:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446567:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446575:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d457d145e00) 00010000:00010000:2.0:1784935517.446577:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935517.446580:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.446592:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301a00/0x857e02f4e0b167df lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935517.446870:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292072064:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784935517.446963:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935517.447729:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292072064 00000100:00100000:1.0:1784935517.447738:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292072064 00000100:00100000:1.0:1784935517.447800:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784935517.447814:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935517.447815:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292072064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784935517.447844:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00000100:00100000:3.0:1784935517.447845:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273118720 00000100:00100000:3.0:1784935517.447850:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273118720 00010000:00010000:3.0:1784935517.447885:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b166b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8b4 expref: 12 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784935517.447889:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a63f458, atime: 0x6a63f458, ctime: 0x6a63f458, blocks: 0x0 00010000:00010000:1.0:1784935517.447901:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f781abe5/0x857e02f4e0b167f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935517.447919:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00100000:3.0:1784935517.447947:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:2392:x1871640273118720:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935517.447949:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1784935517.447957:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935517.447959:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935517.447963:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f781abe5/0x857e02f4e0b167f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.447982:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f781abe5/0x857e02f4e0b167f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.447984:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b166b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8b4 expref: 12 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.448003:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f781abe5/0x857e02f4e0b167f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.448009:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b166b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8b4 expref: 12 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.448016:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f781abe5/0x857e02f4e0b167f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.448032:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.448036:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935517.448046:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.448062:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.448068:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.448075:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.448082:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.448089:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200c00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935517.448093:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.448100:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.448109:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935517.448126:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935517.448173:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:2392:x1871640273118720:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 244us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935517.448182:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00080000:0.0:1784935517.449423:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935517.449692:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1871640292072064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1880us (2725us total) trans 4294967301 rc 0/0 00000004:00080000:2.0:1784935517.449699:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d4566f35180/2, rc 0, transno 4294967301 00000100:00100000:1.0:1784935517.449705:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784935517.449710:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292072064:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1784935517.449733:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784935517.449740:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f781abe5/0x857e02f4e0b167f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.449752:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6ca00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935517.449757:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f781abe5/0x857e02f4e0b167f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.449782:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f781abe5/0x857e02f4e0b167f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.449798:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f781abe5/0x857e02f4e0b167f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.449806:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f781abe5/0x857e02f4e0b167f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.449819:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541529c00/0x857e02f4e0b166b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a8b4 expref: 11 pid: 6517 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935517.449825:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935517.449829:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935517.449831:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935517.449836:0:13734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44423cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1871640292070912:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935517.450068:0:13734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.450079:0:13734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.450085:0:13734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935517.450091:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b167ed lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935518.125127:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935518.125150:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292072192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935518.125212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935518.125268:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292072192 00000100:00100000:1.0:1784935518.125275:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292072192 00000100:00100000:1.0:1784935518.125319:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784935518.125328:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292072192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935518.125355:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935518.125392:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292072192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935518.125398:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1784935518.125434:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443603100 x1871640292072192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935518.125464:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292072192:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784935518.131023:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935518.132812:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292072448:0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.132899:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935518.132959:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292072960:0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.132988:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935518.133015:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784935518.133023:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292072576:0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.133048:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935518.133067:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292073088:0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.133086:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935518.133113:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292072448 00000100:00100000:0.0:1784935518.133119:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292072448 00000100:00100000:0.0:1784935518.133174:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1784935518.133185:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3649:x1871640292072448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.133228:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3649:x1871640292072448:12345-0@lo:400:kworker.0 Request processed in 46us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935518.133234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1784935518.133263:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292072960 00000100:00100000:0.0:1784935518.133266:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292072960 00000100:00100000:0.0:1784935518.133288:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784935518.133293:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292072960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.133321:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292072960:12345-0@lo:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935518.133326:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784935518.133340:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292072576 00000100:00100000:0.0:1784935518.133343:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292072576 00000100:00100000:0.0:1784935518.133362:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292073088 00000100:00100000:0.0:1784935518.133364:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292073088 00000100:00100000:0.0:1784935518.133385:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784935518.133390:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292072576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.133415:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292072576:12345-0@lo:400:kworker.0 Request processed in 25us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935518.133421:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784935518.133433:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1784935518.133437:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292073600:0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.133443:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292073088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.133475:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292073088:12345-0@lo:400:kworker.0 Request processed in 36us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935518.133483:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1784935518.133484:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935518.133511:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784935518.133517:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292073472:0@lo:400:kworker.0 00000100:00100000:3.0:1784935518.133551:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935518.134390:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292073472 00000100:00100000:1.0:1784935518.134397:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292073472 00000100:00100000:1.0:1784935518.134449:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784935518.134457:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1871640292073472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.134510:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1871640292073472:12345-0@lo:400:kworker.0 Request processed in 54us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935518.134516:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784935518.134552:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292072704:0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.134584:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935518.134610:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292073216:0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.134631:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935518.134776:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292073600 00000100:00100000:0.0:1784935518.134786:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292073600 00000100:00100000:0.0:1784935518.134809:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1784935518.134814:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292073600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.134847:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292073600:12345-0@lo:400:kworker.0 Request processed in 33us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935518.134853:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1784935518.135449:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292072576:0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.135461:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292073088:0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.135469:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292072448:0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.135478:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292072960:0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.135509:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292072704 00000100:00100000:0.0:1784935518.135512:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292072704 00000100:00100000:0.0:1784935518.135551:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784935518.135557:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292072704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.135598:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292072704:12345-0@lo:400:kworker.0 Request processed in 41us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935518.135604:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1784935518.135625:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935518.135960:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292073216 00000100:00100000:3.0:1784935518.135966:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292073216 00000100:00100000:1.0:1784935518.136043:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292073728:0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.136077:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935518.136107:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292072704:0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.136118:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1784935518.136199:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292072320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935518.136226:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935518.136244:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292072832:0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.136261:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935518.136273:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292073344:0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.136294:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935518.136310:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292073856:0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.136351:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935518.136381:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292073344 00000100:00100000:1.0:1784935518.136385:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292073344 00000100:00100000:0.0:1784935518.136440:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292073728 00000100:00100000:0.0:1784935518.136444:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292073728 00000100:00080000:2.0:1784935518.140078:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784935518.140090:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935518.140240:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292073856 00000100:00100000:1.0:1784935518.140250:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292073856 00000100:00100000:1.0:1784935518.140281:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784935518.140292:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292073344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.140380:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292073344:12345-0@lo:400:kworker.0 Request processed in 90us (4084us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935518.140387:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784935518.140415:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292072832 00000100:00100000:3.0:1784935518.140421:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292072832 00000100:00100000:3.0:1784935518.140442:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1784935518.140449:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292073728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935518.140493:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292073728:12345-0@lo:400:kworker.0 Request processed in 45us (4415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935518.140500:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1784935518.140512:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1784935518.140518:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292073216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935518.140560:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292073216:12345-0@lo:400:kworker.0 Request processed in 42us (5928us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935518.140566:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1784935518.140579:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784935518.140585:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292072832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935518.140629:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292072832:12345-0@lo:400:kworker.0 Request processed in 45us (4367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935518.140636:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1784935518.140843:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935518.141002:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292072320 00000100:00100000:0.0:1784935518.141008:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292072320 00000100:00100000:0.0:1784935518.141042:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784935518.141050:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1871640292072320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935518.141067:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935518.141108:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1871640292072320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (4881us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935518.141123:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784935518.141178:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292073472:0@lo:400:kworker.0 00000100:00100000:0.0:1784935518.141193:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292073600:0@lo:400:kworker.0 00010000:00080000:2.0:1784935518.141837:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570595c00 x1871640292072320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935518.141866:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292072320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935518.141881:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292072832:0@lo:400:kworker.0 00000100:00100000:2.0:1784935518.141893:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292073344:0@lo:400:kworker.0 00010000:00080000:2.0:1784935518.141905:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443593b80 x1871640292073216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935518.141913:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292073216:0@lo:400:kworker.0 00010000:00080000:2.0:1784935518.141924:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365f800 x1871640292073728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935518.141954:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292073728:0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.141955:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784935518.142045:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292073856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.142119:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292073856:12345-0@lo:400:kworker.0 Request processed in 152us (5765us total) trans 0 rc 0/0 00010000:00080000:2.0:1784935518.142164:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365ce00 x1871640292073856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935518.142173:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292073856:0@lo:400:kworker.0 00000100:00100000:1.0:1784935518.142197:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000020:00000080:1.0:1784935518.242924:0:13783:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe18ccbe50 20000000:00000080:1.0:1784935518.243517:0:13783:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d44430a3000 uarg=0000000000000000 20000000:01000000:1.0:1784935518.243570:0:13783:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1784935518.243577:0:13783:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1784935518.243582:0:13783:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1784935518.246383:0:13784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1784935518.246570:0:13783:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1784935518.246678:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1784935518.246709:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1784935518.246723:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1784935518.246736:0:13783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784935518.246757:0:13783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4443699000/0x857e02f4e0b167fb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935518.246773:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443699000/0x857e02f4e0b167fb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935518.246783:0:13783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4443699000/0x857e02f4e0b167fb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935518.246789:0:13783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4443699000/0x857e02f4e0b167fb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935518.246796:0:13783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4443699000/0x857e02f4e0b167fb lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935518.246803:0:13783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4443699000/0x857e02f4e0b167fb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935518.246810:0:13783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935518.247226:0:13783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4443699000/0x857e02f4e0b167fb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935518.247250:0:13783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4443699000/0x857e02f4e0b167fb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935518.247264:0:13783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4443699000/0x857e02f4e0b167fb lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935518.247272:0:13783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4443699000/0x857e02f4e0b167fb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935518.247278:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443699000/0x857e02f4e0b167fb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935518.317114:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935518.637441:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292073984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935518.637484:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292074112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935518.637512:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935518.637553:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292073984 00000100:00100000:3.0:1784935518.637560:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292073984 00000100:00100000:3.0:1784935518.637677:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784935518.637687:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292073984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935518.637717:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935518.644814:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292073984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7115us (7290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935518.644830:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784935518.644906:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935518.645067:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292073984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935518.645099:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292074112 00000100:00100000:1.0:1784935518.645106:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292074112 00000100:00100000:1.0:1784935518.645179:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784935518.645187:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292074112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784935518.645210:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935518.645269:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292074112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935518.645289:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784935518.645361:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292074112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935518.889735:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935518.889775:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935518.889800:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935518.889830:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935518.889846:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935518.889870:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935518.889899:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273118976 00000100:00100000:1.0:1784935518.889906:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273118976 00000100:00100000:1.0:1784935518.889996:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273119488 00000100:00100000:1.0:1784935518.889999:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273119488 00000100:00100000:1.0:1784935518.890015:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273119104 00000100:00100000:1.0:1784935518.890017:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273119104 00000100:00100000:1.0:1784935518.890029:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273119360 00000100:00100000:1.0:1784935518.890032:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273119360 00000100:00100000:3.0:1784935518.890057:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 205 00000100:00100000:3.0:1784935518.890073:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273118976:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935518.890150:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273119232 00000100:00100000:3.0:1784935518.890156:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273118976:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 88us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935518.890166:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273119232 00000100:00100000:2.0:1784935518.890208:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 80 00000100:00100000:2.0:1784935518.890215:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273119232:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935518.890248:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273119232:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 33us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935518.890256:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 80 00000100:00080000:2.0:1784935518.890279:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784935518.890284:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784935518.890300:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935518.890329:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273118848 00000100:00100000:2.0:1784935518.890334:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273118848 00000100:00100000:2.0:1784935518.890360:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 333 00000100:00100000:2.0:1784935518.890367:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:2394:x1871640273118848:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935518.890393:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:2394:x1871640273118848:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 26us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935518.890400:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 333 00000100:00100000:1.0:1784935518.896461:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 206 00000100:00100000:1.0:1784935518.896487:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273119488:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935518.896597:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273119488:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 123us (6793us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935518.896605:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 206 00000100:00100000:1.0:1784935518.896637:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 207 00000100:00100000:1.0:1784935518.896645:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273119104:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935518.896671:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273119104:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 28us (6824us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935518.896677:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 207 00000100:00100000:1.0:1784935518.896688:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 208 00000100:00100000:1.0:1784935518.896708:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273119360:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935518.896734:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273119360:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 27us (6863us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935518.896739:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 208 00000100:00100000:3.0:1784935518.898872:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 205 10000000:01000000:0.0:1784935519.149060:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784935519.149068:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457d24e000 from 7 10000000:01000000:0.0:1784935519.149073:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784935519.149123:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.149135:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.149146:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935519.149178:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292074240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784935519.149264:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935519.149332:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292074240 00000100:00100000:0.0:1784935519.149334:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581cc1900 going to sleep for 11 seconds 00000100:00100000:3.0:1784935519.149351:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292074240 00000100:00100000:3.0:1784935519.149403:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1784935519.149428:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:6523:x1871640292074240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935519.149442:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935519.149463:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16809 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16802 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935519.149488:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16802 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935519.149500:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16802 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935519.149510:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540031000, rc 0) 00000100:00100000:0.0:1784935519.149546:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292074368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784935519.149635:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292074240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935519.149650:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.149660:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935519.149717:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443585500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292074496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784935519.149754:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292074240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 341us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935519.149762:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1784935519.152976:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935519.155008:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292074368 00000100:00100000:2.0:1784935519.155021:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292074368 00000100:00100000:2.0:1784935519.155083:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784935519.155094:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292074368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784935519.155131:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784935519.155211:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292074368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935519.155219:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784935519.155322:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292074368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784935519.156912:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935519.157399:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935519.157684:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292074496 00000100:00100000:2.0:1784935519.157693:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292074496 00000100:00100000:2.0:1784935519.157805:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1784935519.157817:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292074496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935519.158001:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292074496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935519.158009:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1784935519.158090:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443585500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292074496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935519.158135:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443585500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292074624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935519.158187:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935519.171950:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935519.177001:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292074624 00000100:00100000:3.0:1784935519.177017:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292074624 00000100:00100000:3.0:1784935519.177084:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1784935519.177107:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292074624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784935519.177499:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292074624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 406us (19310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935519.177508:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1784935519.177686:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443585500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292074624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935519.179798:0:13796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443585500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13796:1871640292074752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935519.181973:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935519.182015:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292074752 00000100:00100000:2.0:1784935519.182024:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292074752 00000100:00100000:2.0:1784935519.182076:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1784935519.182085:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:13796:x1871640292074752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935519.182718:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:13796:x1871640292074752:12345-0@lo:502:llog_process_th.0 Request processed in 633us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935519.182727:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1784935519.184233:0:13796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a480 going to sleep for 11 seconds 00000100:00100000:1.0:1784935519.184269:0:13796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443585500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13796:1871640292074752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935519.184308:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935519.184327:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935519.184330:0:13796:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784935519.184336:0:13796:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d457d24e000 00000020:00000080:1.0:1784935519.184339:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935519.184538:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935519.184609:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935519.184611:0:13796:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784935519.184619:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784935519.184622:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935519.184623:0:13796:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784935519.184627:0:13796:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d457d24e000 00000020:00000080:0.0:1784935519.184629:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784935519.188186:0:13796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13796:1871640292074880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935519.188284:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935519.188318:0:13796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581cc1840 going to sleep for 11 seconds 00000100:00100000:3.0:1784935519.188397:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292074880 00000100:00100000:3.0:1784935519.188405:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292074880 00000100:00100000:3.0:1784935519.188461:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784935519.188470:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:13796:x1871640292074880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935519.188595:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:13796:x1871640292074880:12345-0@lo:502:llog_process_th.0 Request processed in 126us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935519.188603:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1784935519.188790:0:13796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13796:1871640292074880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784935519.188827:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935519.188834:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935519.188836:0:13796:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784935519.188842:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784935519.189094:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1784935519.189114:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784935519.189124:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935519.189135:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935519.189146:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784935519.189148:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457b962000 from 7 10000000:01000000:3.0:1784935519.189151:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784935519.189173:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935519.189181:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935519.189190:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935519.189204:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784935519.189235:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935519.189270:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44420629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935519.190372:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292075008 00000100:00100000:1.0:1784935519.190382:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292075008 00000100:00100000:1.0:1784935519.190435:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1784935519.190444:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:6523:x1871640292075008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935519.190459:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935519.190474:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b16817 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16810 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.190497:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b16817 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16810 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.190507:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b16817 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16810 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.190515:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6da00, rc 0) 00000100:00100000:1.0:1784935519.190577:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292075008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935519.190584:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1784935519.195247:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935519.195274:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935519.195286:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935519.195389:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784935519.195448:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935519.195482:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44420629c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935519.195503:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292075136 00000100:00100000:3.0:1784935519.195508:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292075136 00000100:00100000:3.0:1784935519.195554:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1784935519.195563:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292075136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784935519.195677:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292075136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935519.195685:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1784935519.195711:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784935519.195735:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784935519.195773:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935519.195786:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44420629c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935519.195802:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292075264 00000100:00100000:3.0:1784935519.196892:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292075264 00000100:00100000:3.0:1784935519.196949:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1784935519.196956:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292075264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784935519.197064:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292075264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935519.197070:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1784935519.197241:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935519.205734:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443585500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13798:1871640292075392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935519.205831:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935519.205880:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a480 going to sleep for 11 seconds 00000100:00100000:0.0:1784935519.206329:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292075392 00000100:00100000:0.0:1784935519.206336:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292075392 00000100:00100000:0.0:1784935519.206375:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1784935519.206383:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:13798:x1871640292075392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935519.206509:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:13798:x1871640292075392:12345-0@lo:502:llog_process_th.0 Request processed in 126us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935519.206517:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1784935519.207312:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443585500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13798:1871640292075392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784935519.207352:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935519.207362:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935519.207364:0:13798:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784935519.207371:0:13798:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d457b962000 00000020:00000080:2.0:1784935519.207374:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784935519.207442:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935519.207446:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935519.207448:0:13798:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784935519.207450:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935519.207453:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935519.207454:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784935519.207457:0:13798:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d457b962000 00000020:00000080:2.0:1784935519.207459:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784935519.207502:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13798:1871640292075520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935519.207566:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935519.207605:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a480 going to sleep for 11 seconds 00000100:00100000:0.0:1784935519.207981:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292075520 00000100:00100000:0.0:1784935519.207993:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292075520 00000100:00100000:0.0:1784935519.208030:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1784935519.208038:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:13798:x1871640292075520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935519.208133:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:13798:x1871640292075520:12345-0@lo:502:llog_process_th.0 Request processed in 95us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935519.208140:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1784935519.208462:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13798:1871640292075520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784935519.208487:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935519.208492:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935519.208494:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784935519.208497:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1784935519.211263:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1784935519.211301:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784935519.211312:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.211322:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935519.211333:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784935519.211336:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4570c47800 from 7 10000000:01000000:0.0:1784935519.211338:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784935519.211374:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.211382:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.211391:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935519.211412:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784935519.211473:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935519.211506:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581cc1480 going to sleep for 11 seconds 00000100:00100000:1.0:1784935519.212578:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292075648 00000100:00100000:1.0:1784935519.212587:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292075648 00000100:00100000:1.0:1784935519.212644:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1784935519.212653:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:6523:x1871640292075648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935519.212684:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935519.212700:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4442a6ca00/0x857e02f4e0b16825 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1681e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.212725:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4442a6ca00/0x857e02f4e0b16825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1681e expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.212736:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4442a6ca00/0x857e02f4e0b16825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1681e expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.212744:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6ca00, rc 0) 00000100:00100000:1.0:1784935519.212800:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292075648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935519.212816:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1784935519.214426:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935519.214597:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935519.214624:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.214637:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935519.214716:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935519.214737:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273119616 00000100:00100000:2.0:1784935519.214751:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273119616 00000100:00100000:0.0:1784935519.214759:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935519.214795:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581cc1480 going to sleep for 11 seconds 00000100:00100000:1.0:1784935519.214868:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292075776 00000100:00100000:1.0:1784935519.214872:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292075776 00000100:00100000:1.0:1784935519.214914:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1784935519.214923:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292075776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935519.215069:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292075776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935519.215077:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1784935519.215114:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935519.215143:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935519.215185:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935519.215203:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581cc1480 going to sleep for 11 seconds 00000100:00100000:0.0:1784935519.215254:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292075904 00000100:00100000:0.0:1784935519.215258:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292075904 00000100:00100000:0.0:1784935519.215274:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 346 00000100:00100000:0.0:1784935519.215282:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:6162:x1871640273119616:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935519.215292:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935519.215310:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443698200/0x857e02f4e0b1682c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a908 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.215329:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443698200/0x857e02f4e0b1682c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a908 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.215340:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443698200/0x857e02f4e0b1682c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a908 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.215360:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698200, rc 0) 00000100:00100000:0.0:1784935519.215402:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273119616:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 Request processed in 120us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935519.215409:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 346 00000100:00100000:0.0:1784935519.215434:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1784935519.215439:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292075904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935519.215519:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292075904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935519.215607:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1784935519.215648:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292075904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784935519.216468:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784935519.218519:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13801:1871640292076032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935519.218599:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935519.218634:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292076032 00000100:00100000:1.0:1784935519.218641:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292076032 00000100:00100000:1.0:1784935519.218699:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1784935519.218708:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:13801:x1871640292076032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935519.218839:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:13801:x1871640292076032:12345-0@lo:502:llog_process_th.0 Request processed in 131us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935519.218847:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1784935519.218907:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4550c7e600 going to sleep for 11 seconds 00000100:00100000:1.0:1784935519.218949:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13801:1871640292076032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935519.218982:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935519.218993:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935519.218996:0:13801:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784935519.219005:0:13801:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4570c47800 00000020:00000080:1.0:1784935519.219008:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935519.219056:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935519.219316:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935519.219318:0:13801:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784935519.219324:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935519.219328:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935519.219330:0:13801:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1784935519.219335:0:13801:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4570c47800 00000020:00000080:1.0:1784935519.219338:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784935519.219536:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13801:1871640292076160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935519.219580:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935519.219601:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581cc1480 going to sleep for 11 seconds 00000100:00100000:0.0:1784935519.219622:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292076160 00000100:00100000:0.0:1784935519.219626:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292076160 00000100:00100000:0.0:1784935519.219658:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1784935519.219667:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:13801:x1871640292076160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935519.219748:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:13801:x1871640292076160:12345-0@lo:502:llog_process_th.0 Request processed in 83us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935519.219756:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784935519.219966:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13801:1871640292076160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935519.219987:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935519.219991:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935519.219993:0:13801:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1784935519.219996:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1784935519.220049:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1784935519.220072:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784935519.220083:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.220095:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935519.220113:0:6523:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784935519.220116:0:6523:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4570329000 from 7 10000000:01000000:1.0:1784935519.220118:0:6523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784935519.220144:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.220151:0:6523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.220161:0:6523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935519.220174:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292076288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935519.220210:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935519.220239:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541ab3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935519.220253:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292076288 00000100:00100000:1.0:1784935519.220257:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292076288 00000100:00100000:1.0:1784935519.220288:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784935519.220297:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:6523:x1871640292076288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935519.220306:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935519.220318:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4442a6c200/0x857e02f4e0b1683a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b16833 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.220340:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4442a6c200/0x857e02f4e0b1683a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b16833 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.220350:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4442a6c200/0x857e02f4e0b1683a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b16833 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.220371:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6c200, rc 0) 00000100:00100000:1.0:1784935519.220405:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292076288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935519.220412:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784935519.220444:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292076288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935519.220457:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935519.220466:0:6523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935519.220508:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292076416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935519.220549:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935519.220567:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4550c7e240 going to sleep for 11 seconds 00000100:00100000:0.0:1784935519.220570:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292076416 00000100:00100000:0.0:1784935519.220575:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292076416 00000100:00100000:0.0:1784935519.220602:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1784935519.220609:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292076416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935519.220703:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292076416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935519.220709:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1784935519.221038:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292076416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935519.221071:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292076544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935519.221110:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935519.221139:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4550c7e240 going to sleep for 11 seconds 00000100:00100000:2.0:1784935519.221234:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292076544 00000100:00100000:2.0:1784935519.221239:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292076544 00000100:00100000:2.0:1784935519.221278:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784935519.221287:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292076544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935519.221378:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:6523:x1871640292076544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935519.221385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1784935519.221666:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6dcb3e6c-7883-4388-9dd1-46646343e0f5:6523:1871640292076544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935519.226061:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570594000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13803:1871640292076672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935519.226190:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935519.226264:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935519.226299:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292076672 00000100:00100000:2.0:1784935519.226306:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292076672 00000100:00100000:2.0:1784935519.226392:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1784935519.226401:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:13803:x1871640292076672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935519.226532:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:13803:x1871640292076672:12345-0@lo:502:llog_process_th.0 Request processed in 124us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935519.226539:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1784935519.226613:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570594000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13803:1871640292076672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935519.226643:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935519.226658:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935519.226660:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784935519.226674:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4570329000 00000020:00000080:1.0:1784935519.226678:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935519.226737:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935519.227008:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935519.227011:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784935519.227015:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935519.227018:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935519.227020:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1784935519.227025:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4570329000 00000020:00000080:1.0:1784935519.227027:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784935519.227188:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13803:1871640292076800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935519.227225:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935519.227421:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541ab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935519.229211:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292076800 00000100:00100000:3.0:1784935519.229223:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292076800 00000100:00100000:3.0:1784935519.229273:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1784935519.229280:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:13803:x1871640292076800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935519.229412:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:13803:x1871640292076800:12345-0@lo:502:llog_process_th.0 Request processed in 131us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935519.229420:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1784935519.229705:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935519.229754:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6dcb3e6c-7883-4388-9dd1-46646343e0f5:13803:1871640292076800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935519.229788:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935519.229796:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935519.229798:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1784935519.229803:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:2.0:1784935519.230276:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273119744 00000100:00100000:2.0:1784935519.230282:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273119744 00000100:00100000:2.0:1784935519.230311:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 355 00000100:00100000:2.0:1784935519.230318:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273119744:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935519.230422:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273119744:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 Request processed in 104us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935519.230430:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 355 00000020:01000000:0.0:1784935519.230995:0:6523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1784935519.231025:0:6523:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784935519.231036:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.231048:0:6523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784935519.232503:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784935519.232657:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935519.232773:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273119872 00000100:00100000:2.0:1784935519.232782:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273119872 00000100:00100000:2.0:1784935519.232841:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 356 00000100:00100000:2.0:1784935519.232862:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273119872:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935519.232995:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273119872:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 Request processed in 135us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935519.233003:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 356 00000100:00100000:3.0:1784935519.240532:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935519.240602:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273120000 00000100:00100000:0.0:1784935519.240612:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273120000 00000100:00100000:0.0:1784935519.240668:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 357 00000100:00100000:0.0:1784935519.240677:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:10761:x1871640273120000:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784935519.240844:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:10761:x1871640273120000:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 167us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935519.240853:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 357 00000100:00100000:1.0:1784935519.252964:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935519.253692:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273120128 00000100:00100000:2.0:1784935519.253702:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273120128 00000100:00100000:2.0:1784935519.253759:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 358 00000100:00100000:2.0:1784935519.253769:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:10761:x1871640273120128:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784935519.254085:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:10761:x1871640273120128:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 315us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935519.254094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 358 00000100:00100000:2.0:1784935519.267613:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935519.267770:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273120256 00000100:00100000:0.0:1784935519.267779:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273120256 00000100:00100000:0.0:1784935519.267890:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 359 00000100:00100000:0.0:1784935519.267901:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:6162:x1871640273120256:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935519.267918:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935519.267949:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443699e00/0x857e02f4e0b16841 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313a90f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.268120:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443699e00/0x857e02f4e0b16841 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a90f expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.268143:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443699e00/0x857e02f4e0b16841 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a90f expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935519.268153:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699e00, rc 0) 00000100:00100000:0.0:1784935519.268208:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:6162:x1871640273120256:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 Request processed in 308us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935519.268215:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 359 00000100:00100000:1.0:1784935519.271326:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935519.271420:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273120384 00000100:00100000:2.0:1784935519.271429:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273120384 00000100:00100000:2.0:1784935519.271480:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 360 00000100:00100000:2.0:1784935519.271489:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:6162:x1871640273120384:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935519.271651:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:6162:x1871640273120384:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 Request processed in 162us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935519.271659:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 360 00000100:00100000:1.0:1784935519.276325:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935519.276573:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273120512 00000100:00100000:0.0:1784935519.276582:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273120512 00000100:00100000:0.0:1784935519.276637:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 361 00000100:00100000:0.0:1784935519.276647:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:6162:x1871640273120512:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935519.280320:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:6162:x1871640273120512:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 Request processed in 3663us (3991us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935519.280333:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 361 00000100:00100000:2.0:1784935519.289995:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935519.290287:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273120640 00000100:00100000:1.0:1784935519.290306:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273120640 00000100:00100000:1.0:1784935519.290353:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 362 00000100:00100000:1.0:1784935519.290362:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:10764:x1871640273120640:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784935519.290495:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:10764:x1871640273120640:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 126us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935519.290503:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 362 00000100:00100000:1.0:1784935519.302314:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935519.305810:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273120768 00000100:00100000:3.0:1784935519.305825:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273120768 00000100:00100000:3.0:1784935519.305961:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 363 00000100:00100000:3.0:1784935519.305972:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:10764:x1871640273120768:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784935519.306322:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:10764:x1871640273120768:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 351us (4016us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935519.306330:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 363 00010000:00010000:2.0:1784935519.343616:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784935520.237735:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1784935520.245585:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784935520.375372:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935521.389445:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935521.711756:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292076928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935521.711847:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935521.712048:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292076928 00000100:00100000:0.0:1784935521.712055:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292076928 00000100:00100000:0.0:1784935521.712102:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1784935521.712110:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292076928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935521.712142:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784935521.712192:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292076928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935521.712198:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784935521.712625:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292076928:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784935522.413281:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784935522.734567:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1784935523.245865:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784935523.245894:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292077056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935523.245981:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935523.246140:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292077056 00000100:00100000:1.0:1784935523.246148:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292077056 00000100:00100000:1.0:1784935523.246213:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784935523.246223:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292077056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935523.246263:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935523.246310:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292077056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935523.246317:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784935523.246698:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292077440:0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.246735:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935523.246757:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292077952:0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.246779:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935523.246793:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292078464:0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.246832:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935523.246851:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784935523.246857:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292077312:0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.246890:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935523.246910:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292077824:0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.246967:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935523.246989:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292078336:0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.247010:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935523.247142:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292077440 00000100:00100000:0.0:1784935523.247148:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292077440 00000100:00100000:0.0:1784935523.247183:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784935523.247190:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292077440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.247243:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292077440:12345-0@lo:400:kworker.0 Request processed in 53us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935523.247250:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784935523.247269:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292077952 00000100:00100000:0.0:1784935523.247272:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292077952 00000100:00100000:0.0:1784935523.247292:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292078464 00000100:00100000:0.0:1784935523.247294:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292078464 00000100:00100000:0.0:1784935523.247305:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292077312 00000100:00100000:0.0:1784935523.247307:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292077312 00000100:00100000:0.0:1784935523.247316:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292077824 00000100:00100000:0.0:1784935523.247318:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292077824 00000100:00100000:0.0:1784935523.247327:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292078336 00000100:00100000:0.0:1784935523.247329:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292078336 00000100:00100000:0.0:1784935523.247357:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1784935523.247363:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292077952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.247392:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292077952:12345-0@lo:400:kworker.0 Request processed in 30us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935523.247406:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1784935523.247419:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1784935523.247425:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292078464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.247455:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292078464:12345-0@lo:400:kworker.0 Request processed in 30us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935523.247460:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1784935523.247470:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1784935523.247476:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292077312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.247512:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292077312:12345-0@lo:400:kworker.0 Request processed in 36us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935523.247518:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1784935523.247529:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1784935523.247534:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292077824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.247562:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292077824:12345-0@lo:400:kworker.0 Request processed in 27us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935523.247568:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1784935523.247578:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1784935523.247584:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292078336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.247610:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292078336:12345-0@lo:400:kworker.0 Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935523.247615:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1784935523.247653:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292077312:0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.247664:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292077824:0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.247685:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292078336:0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.247695:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292077440:0@lo:400:kworker.0 00010000:00080000:0.0:1784935523.247704:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566f36d80 x1871640292077952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935523.247713:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292077952:0@lo:400:kworker.0 00010000:00080000:0.0:1784935523.247721:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d4a80 x1871640292078464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935523.247728:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292078464:0@lo:400:kworker.0 00000100:00080000:3.0:1784935523.247824:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784935523.247829:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784935523.247831:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935523.247849:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292077184:0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.247885:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935523.247922:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292077696:0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.247973:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935523.247992:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292078208:0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248015:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784935523.248049:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443585880 x1871640292077056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935523.248065:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292077056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935523.248084:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784935523.248091:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292077568:0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248113:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935523.248131:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292078080:0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248151:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935523.248165:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292078592:0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248185:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935523.248210:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292078208 00000100:00100000:3.0:1784935523.248215:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292078208 00000100:00100000:3.0:1784935523.248246:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292078080 00000100:00100000:3.0:1784935523.248248:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292078080 00000100:00100000:3.0:1784935523.248260:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292078592 00000100:00100000:3.0:1784935523.248262:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292078592 00000100:00100000:3.0:1784935523.248275:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784935523.248281:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292078208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248316:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292078208:12345-0@lo:400:kworker.0 Request processed in 35us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935523.248321:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784935523.248332:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784935523.248336:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292078080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248369:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292078080:12345-0@lo:400:kworker.0 Request processed in 32us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935523.248375:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784935523.248386:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784935523.248391:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292078592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248415:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292078592:12345-0@lo:400:kworker.0 Request processed in 25us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935523.248421:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784935523.248440:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292077696 00000100:00100000:3.0:1784935523.248443:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292077696 00000100:00100000:3.0:1784935523.248463:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784935523.248468:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292077696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248508:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292077696:12345-0@lo:400:kworker.0 Request processed in 39us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935523.248513:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1784935523.248527:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784935523.248530:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935523.248537:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292077568 00000100:00100000:3.0:1784935523.248540:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292077568 00000100:00100000:3.0:1784935523.248560:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1784935523.248565:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292077568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248589:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292077568:12345-0@lo:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935523.248593:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1784935523.248615:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292077568:0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248623:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292078080:0@lo:400:kworker.0 00010000:00080000:3.0:1784935523.248642:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d4000 x1871640292078592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935523.248650:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292078592:0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248657:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292077696:0@lo:400:kworker.0 00000100:00100000:3.0:1784935523.248664:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1784935523.248668:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d4566f35180, transno 4294967301 00000100:00100000:3.0:1784935523.248677:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292078208:0@lo:400:kworker.0 00000100:00100000:2.0:1784935523.249552:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935523.249567:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292078720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935523.249612:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935523.249701:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292078720 00000100:00100000:1.0:1784935523.249709:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292078720 00000100:00100000:1.0:1784935523.249751:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784935523.249759:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292078720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784935523.249777:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935523.249822:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292078720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935523.249828:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784935523.250187:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292077184 00000100:00100000:0.0:1784935523.250192:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292077184 00000100:00100000:0.0:1784935523.250223:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1784935523.250231:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3650:x1871640292077184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935523.250274:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3650:x1871640292077184:12345-0@lo:400:kworker.0 Request processed in 45us (2390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935523.250280:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00080000:2.0:1784935523.250825:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365ea00 x1871640292078720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935523.250843:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292078720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935523.250873:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292077184:0@lo:400:kworker.0 00010000:00010000:2.0:1784935523.445431:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935523.757477:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292078848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935523.757556:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935523.757877:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292078848 00000100:00100000:1.0:1784935523.757885:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292078848 00000100:00100000:1.0:1784935523.757949:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784935523.757973:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292078848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784935523.758000:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935523.758050:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292078848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935523.758057:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784935523.758103:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292078848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935523.758736:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292078976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935523.758779:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935523.758869:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292078976 00000100:00100000:3.0:1784935523.758875:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292078976 00000100:00100000:3.0:1784935523.758914:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784935523.758922:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292078976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784935523.758956:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935523.759003:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292078976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935523.759009:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784935523.759083:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292078976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935524.009236:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935524.009337:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935524.009368:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935524.009397:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935524.009423:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935524.009444:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935524.009658:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273121152 00000100:00100000:3.0:1784935524.009667:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273121152 00000100:00100000:3.0:1784935524.009720:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273121408 00000100:00100000:3.0:1784935524.009724:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273121408 00000100:00100000:3.0:1784935524.009737:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273121024 00000100:00100000:3.0:1784935524.009752:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273121024 00000100:00100000:3.0:1784935524.009770:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273121536 00000100:00100000:3.0:1784935524.009773:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273121536 00000100:00100000:3.0:1784935524.009791:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 215 00000100:00100000:3.0:1784935524.009800:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273121152:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935524.009870:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273121152:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 71us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935524.009984:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 215 00000100:00100000:3.0:1784935524.010002:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 216 00000100:00100000:3.0:1784935524.010009:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273121408:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935524.010035:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273121408:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 27us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935524.010041:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 216 00000100:00100000:3.0:1784935524.010054:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 217 00000100:00100000:3.0:1784935524.010059:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273121024:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935524.010079:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273121024:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 21us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935524.010085:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 217 00000100:00100000:3.0:1784935524.010095:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 218 00000100:00100000:3.0:1784935524.010100:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273121536:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935524.010119:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273121536:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 19us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935524.010125:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 218 00000100:00080000:3.0:1784935524.010140:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784935524.010143:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935524.010160:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273121280 00000100:00100000:3.0:1784935524.010163:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273121280 00000100:00100000:3.0:1784935524.010194:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 84 00000100:00100000:3.0:1784935524.010200:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273121280:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935524.010228:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273121280:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 27us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935524.010235:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 84 00000100:00080000:3.0:1784935524.010251:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935524.010825:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273120896 00000100:00100000:1.0:1784935524.010832:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273120896 00000100:00100000:1.0:1784935524.010868:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 365 00000100:00100000:1.0:1784935524.010875:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2393:x1871640273120896:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935524.010909:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2393:x1871640273120896:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 35us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935524.010916:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 365 00000100:00100000:3.0:1784935524.270753:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784935524.270776:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292079104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784935524.270842:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935524.273144:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292079104 00000100:00100000:0.0:1784935524.273157:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292079104 00000100:00100000:0.0:1784935524.273224:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784935524.273234:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292079104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935524.273272:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935524.273381:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292079104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935524.273388:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1784935524.273735:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292079104:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784935524.465539:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935525.486108:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935526.509223:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935526.829271:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935526.838395:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292079232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935526.838487:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935526.838838:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292079232 00000100:00100000:3.0:1784935526.838847:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292079232 00000100:00100000:3.0:1784935526.838896:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784935526.838904:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292079232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784935526.838971:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784935526.839033:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292079232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935526.839040:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784935526.840303:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292079232:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784935527.533998:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935528.368575:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935528.368611:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292079360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935528.368685:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935528.368798:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292079360 00000100:00100000:3.0:1784935528.368806:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292079360 00000100:00100000:3.0:1784935528.368899:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784935528.368908:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292079360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784935528.368952:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935528.369000:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292079360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935528.369020:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1784935528.369066:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365f800 x1871640292079360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935528.369084:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292079360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935528.369523:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292079488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935528.369554:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935528.369752:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292079488 00000100:00100000:1.0:1784935528.369758:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292079488 00000100:00080000:2.0:1784935528.369835:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935528.370002:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292079872:0@lo:400:kworker.0 00000100:00100000:0.0:1784935528.370034:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935528.370055:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292080384:0@lo:400:kworker.0 00000100:00100000:3.0:1784935528.370069:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292079744:0@lo:400:kworker.0 00000100:00100000:0.0:1784935528.370077:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935528.370095:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292080896:0@lo:400:kworker.0 00000100:00100000:3.0:1784935528.370111:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935528.370145:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292080256:0@lo:400:kworker.0 00000100:00100000:3.0:1784935528.370166:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935528.370594:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292079616:0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.370629:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935528.370653:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292080128:0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.370674:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935528.370702:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292080640:0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.370723:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935528.370754:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292079872 00000100:00100000:2.0:1784935528.370760:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292079872 00000100:00100000:2.0:1784935528.370791:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292080128 00000100:00100000:2.0:1784935528.370794:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292080128 00000100:00100000:2.0:1784935528.370808:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1784935528.370814:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292079872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.370860:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292079872:12345-0@lo:400:kworker.0 Request processed in 45us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935528.370867:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1784935528.370883:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784935528.370888:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292080128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.370918:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292080128:12345-0@lo:400:kworker.0 Request processed in 30us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935528.370924:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784935528.370962:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292080640 00000100:00100000:2.0:1784935528.370966:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292080640 00000100:00100000:1.0:1784935528.371418:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784935528.371428:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292079488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935528.371454:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935528.371499:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292079488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935528.371506:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784935528.371528:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292079616 00000100:00100000:1.0:1784935528.371532:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292079616 00000100:00100000:1.0:1784935528.371558:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1784935528.371564:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292079616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935528.371620:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292079616:12345-0@lo:400:kworker.0 Request processed in 56us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935528.371627:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1784935528.371898:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784935528.371905:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292080640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.371960:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292080640:12345-0@lo:400:kworker.0 Request processed in 55us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935528.371967:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1784935528.371986:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935528.372014:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292079616:0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.372027:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292080128:0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.372049:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292080640:0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.372104:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292080000:0@lo:400:kworker.0 00000100:00100000:3.0:1784935528.374474:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292080768:0@lo:400:kworker.0 00000100:00100000:3.0:1784935528.374533:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935528.380068:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292080384 00000100:00100000:0.0:1784935528.380084:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292080384 00000100:00100000:0.0:1784935528.380162:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292079744 00000100:00100000:0.0:1784935528.380166:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292079744 00000100:00100000:0.0:1784935528.380187:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292080256 00000100:00100000:0.0:1784935528.380189:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292080256 00000100:00100000:0.0:1784935528.380209:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1784935528.380224:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292080384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.380317:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292080768 00000100:00100000:2.0:1784935528.380322:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292080768 00000100:00100000:2.0:1784935528.380348:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1784935528.380354:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292079744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935528.380521:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784935528.380531:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292080256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935528.381720:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292080384:12345-0@lo:400:kworker.0 Request processed in 1496us (11633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935528.381731:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1784935528.381746:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292079744:12345-0@lo:400:kworker.0 Request processed in 1392us (11634us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935528.381753:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1784935528.381756:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1784935528.381784:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935528.381811:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292080512:0@lo:400:kworker.0 00000100:00100000:3.0:1784935528.381871:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784935528.381914:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443587800 x1871640292079488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935528.381949:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292079488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935528.381986:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292080512 00000100:00100000:3.0:1784935528.381991:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292080512 00000100:00100000:3.0:1784935528.382026:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784935528.382033:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292080512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935528.382073:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292080512:12345-0@lo:400:kworker.0 Request processed in 42us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935528.382086:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784935528.382133:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292080512:0@lo:400:kworker.0 00000100:00100000:3.0:1784935528.382157:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292079744:0@lo:400:kworker.0 00000100:00100000:3.0:1784935528.382188:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292080000 00000100:00100000:3.0:1784935528.382192:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292080000 00000100:00100000:0.0:1784935528.382415:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292080768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935528.382447:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292080768:12345-0@lo:400:kworker.0 Request processed in 35us (7914us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935528.382514:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292080256:12345-0@lo:400:kworker.0 Request processed in 1984us (12345us total) trans 0 rc 0/0 00000100:00080000:2.0:1784935528.382684:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784935528.382689:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784935528.382692:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784935528.382723:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292080256:0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.382734:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292080768:0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.382775:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935528.382810:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292079872:0@lo:400:kworker.0 00010000:00080000:2.0:1784935528.382822:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d45412ebb80 x1871640292080384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935528.382831:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292080384:0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.382848:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292080896 00000100:00100000:2.0:1784935528.382851:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292080896 00000100:00100000:2.0:1784935528.382880:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1784935528.382885:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292080896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935528.382922:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292080896:12345-0@lo:400:kworker.0 Request processed in 36us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935528.382953:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:2.0:1784935528.382972:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1784935528.382988:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d45412eb480 x1871640292080896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935528.382996:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292080896:0@lo:400:kworker.0 00000100:00100000:3.0:1784935528.385567:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784935528.385741:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292080000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935528.385847:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292080000:12345-0@lo:400:kworker.0 Request processed in 268us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935528.385854:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1784935528.385968:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292080000:0@lo:400:kworker.0 00000100:00100000:0.0:1784935528.388469:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784935528.388546:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00010000:3.0:1784935528.557391:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935528.879616:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292081024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935528.879685:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935528.880661:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292081024 00000100:00100000:3.0:1784935528.880669:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292081024 00000100:00100000:3.0:1784935528.880716:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784935528.880726:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292081024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784935528.880756:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935528.880817:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292081024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935528.880824:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784935528.880861:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44435a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292081152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935528.880892:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935528.880941:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292081152 00000100:00100000:3.0:1784935528.880945:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292081152 00000100:00100000:3.0:1784935528.880967:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784935528.880973:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292081152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935528.880997:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935528.881030:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292081152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935528.881037:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784935528.881079:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292081024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935528.881114:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44435a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292081152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935529.130419:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935529.130479:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935529.130515:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273121792 00000100:00100000:2.0:1784935529.130524:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273121792 00000100:00100000:2.0:1784935529.130604:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 225 00000100:00100000:2.0:1784935529.130615:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273121792:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935529.130698:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273121792:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935529.130706:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 225 00000100:00100000:3.0:1784935529.130711:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273122048 00000100:00100000:3.0:1784935529.130715:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273122048 00000100:00100000:3.0:1784935529.130746:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 87 00000100:00100000:3.0:1784935529.130752:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273122048:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935529.130781:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273122048:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 29us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935529.130788:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 87 00000100:00100000:0.0:1784935529.130871:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00080000:1.0:1784935529.130879:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935529.130884:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935529.130966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935529.131616:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273121664 00000100:00100000:1.0:1784935529.131624:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273121664 00000100:00100000:1.0:1784935529.131670:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 367 00000100:00100000:1.0:1784935529.131678:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273121664:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935529.131720:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273121664:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 42us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935529.131726:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 367 00000100:00100000:0.0:1784935529.131966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935529.139574:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935529.151528:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273122304 00000100:00100000:1.0:1784935529.151544:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273122304 00000100:00100000:1.0:1784935529.151764:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273121920 00000100:00100000:1.0:1784935529.151769:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273121920 00000100:00080000:0.0:1784935529.151956:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935529.151983:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273122176 00000100:00100000:0.0:1784935529.151987:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273122176 00000100:00100000:0.0:1784935529.152028:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 226 00000100:00100000:0.0:1784935529.152037:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273122304:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935529.152116:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273122304:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 79us (21244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935529.152124:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 226 00000100:00100000:0.0:1784935529.152143:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 227 00000100:00100000:0.0:1784935529.152149:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273122176:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935529.152176:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273122176:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 27us (12613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935529.152183:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 227 00000100:00080000:0.0:1784935529.152200:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935529.153240:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 228 00000100:00100000:1.0:1784935529.153250:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273121920:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935529.160217:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273121920:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 6958us (28240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935529.160233:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 228 00000100:00100000:3.0:1784935529.389225:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292081280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784935529.389297:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935529.389481:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292081280 00000100:00100000:2.0:1784935529.389489:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292081280 00000100:00100000:2.0:1784935529.389551:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784935529.389560:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292081280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784935529.389592:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784935529.398957:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292081280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9388us (9650us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935529.398972:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784935529.401286:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443585c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292081280:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784935529.582984:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784935530.477677:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1784935530.479077:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784935530.605147:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935531.629964:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935531.955177:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292081408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784935531.955249:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935531.955638:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292081408 00000100:00100000:1.0:1784935531.955646:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292081408 00000100:00100000:1.0:1784935531.955695:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784935531.955704:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292081408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784935531.955736:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784935531.955791:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292081408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935531.955798:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784935531.955881:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292081408:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784935532.653156:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935533.486187:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292081664:0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.486257:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935533.486321:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292082176:0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.486344:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935533.486374:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292082688:0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.486396:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935533.486412:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784935533.486417:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292081792:0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.486451:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935533.486467:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292082304:0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.486486:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935533.486499:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292082816:0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.486516:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292081536:0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.486517:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935533.486534:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44435a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292083200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935533.486547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935533.486599:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292081664 00000100:00100000:0.0:1784935533.486607:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292081664 00000100:00100000:2.0:1784935533.486617:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292081920:0@lo:400:kworker.0 00000100:00100000:0.0:1784935533.486653:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292082176 00000100:00100000:0.0:1784935533.486658:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292082176 00000100:00100000:0.0:1784935533.486684:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292082688 00000100:00100000:0.0:1784935533.486699:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292082688 00000100:00100000:0.0:1784935533.486716:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292082304 00000100:00100000:0.0:1784935533.486718:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292082304 00000100:00100000:0.0:1784935533.486729:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292082816 00000100:00100000:0.0:1784935533.486731:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292082816 00000100:00100000:0.0:1784935533.486747:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1784935533.486753:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292081664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.488961:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935533.489093:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292081536 00000100:00100000:1.0:1784935533.489112:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292081536 00000100:00100000:1.0:1784935533.489159:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1784935533.489167:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292081536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.489214:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292081536:12345-0@lo:400:kworker.0 Request processed in 48us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935533.489221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1784935533.489438:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935533.489450:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292083328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935533.489479:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935533.489506:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292083200 00000100:00100000:1.0:1784935533.489510:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292083200 00000100:00100000:1.0:1784935533.489537:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292083328 00000100:00100000:3.0:1784935533.489799:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292081536:0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.489809:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292082048:0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.489816:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292083328 00000100:00100000:1.0:1784935533.489840:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784935533.489906:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292083200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784935533.489945:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935533.489987:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292083200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935533.489993:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784935533.490006:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784935533.490011:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292083328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935533.490021:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935533.490056:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292083328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935533.490062:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784935533.490172:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935533.490195:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292082560:0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.490220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935533.490236:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292083072:0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.490256:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935533.490302:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292082560 00000100:00100000:3.0:1784935533.490306:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292082560 00000100:00100000:3.0:1784935533.490334:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292083072 00000100:00100000:3.0:1784935533.490336:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292083072 00000100:00100000:1.0:1784935533.490378:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292081792 00000100:00100000:1.0:1784935533.490383:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292081792 00000100:00100000:1.0:1784935533.490440:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292082048 00000100:00100000:1.0:1784935533.490444:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292082048 00000100:00100000:1.0:1784935533.490458:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784935533.490464:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292081792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.490500:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292081792:12345-0@lo:400:kworker.0 Request processed in 36us (4048us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935533.490507:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784935533.490519:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784935533.490525:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292082048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.490539:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784935533.490551:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45743ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292082560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.491216:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45743ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292082560:12345-0@lo:400:kworker.0 Request processed in 666us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935533.491223:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784935533.491273:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292082048:12345-0@lo:400:kworker.0 Request processed in 746us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935533.491282:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:1.0:1784935533.491331:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443584380 x1871640292083328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935533.491354:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292083328:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1784935533.491371:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44435a7480 x1871640292083200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935533.491385:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44435a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292083200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935533.491411:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292081792:0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.491441:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784935533.491452:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292083072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.491460:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784935533.491471:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292082176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.491493:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292083072:12345-0@lo:400:kworker.0 Request processed in 44us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935533.491500:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784935533.491523:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292082176:12345-0@lo:400:kworker.0 Request processed in 54us (5176us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935533.491531:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784935533.491611:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784935533.491621:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292082688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.491654:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292082688:12345-0@lo:400:kworker.0 Request processed in 36us (5257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935533.491660:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784935533.491676:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1784935533.491682:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292082304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.491722:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292082304:12345-0@lo:400:kworker.0 Request processed in 40us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935533.491728:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1784935533.491741:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1784935533.491747:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292082816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.491773:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292082816:12345-0@lo:400:kworker.0 Request processed in 27us (5255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935533.491779:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1784935533.491805:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292082048:0@lo:400:kworker.0 00000100:00100000:3.0:1784935533.491908:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292082560:0@lo:400:kworker.0 00010000:00080000:3.0:1784935533.491922:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443590000 x1871640292083072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935533.491947:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292083072:0@lo:400:kworker.0 00010000:00080000:1.0:1784935533.492000:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566f36d80 x1871640292082304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935533.492011:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292082304:0@lo:400:kworker.0 00010000:00080000:1.0:1784935533.492021:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d4a80 x1871640292082816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935533.492028:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292082816:0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.492039:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292082688:0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.492048:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292082176:0@lo:400:kworker.0 00000100:00100000:2.0:1784935533.496614:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935533.496666:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292082432:0@lo:400:kworker.0 00000100:00080000:1.0:1784935533.496791:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935533.496798:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784935533.496801:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784935533.496804:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935533.496824:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292081920 00000100:00100000:1.0:1784935533.496831:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292081920 00000100:00100000:1.0:1784935533.496881:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1784935533.496891:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292081920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935533.496970:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292081920:12345-0@lo:400:kworker.0 Request processed in 80us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935533.496976:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784935533.497392:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935533.497435:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292082944:0@lo:400:kworker.0 00000100:00100000:2.0:1784935533.497459:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935533.497501:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292081920:0@lo:400:kworker.0 00000100:00100000:2.0:1784935533.497534:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292082432 00000100:00100000:2.0:1784935533.497537:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292082432 00000100:00100000:2.0:1784935533.497571:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292082944 00000100:00100000:2.0:1784935533.497574:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292082944 00000100:00100000:2.0:1784935533.497590:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784935533.497597:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292082432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935533.497636:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292082432:12345-0@lo:400:kworker.0 Request processed in 39us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935533.497642:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784935533.497654:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784935533.497660:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292082944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935533.498330:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292082944:12345-0@lo:400:kworker.0 Request processed in 667us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935533.498337:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1784935533.498366:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935533.498409:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292082432:0@lo:400:kworker.0 00010000:00080000:2.0:1784935533.498490:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d7480 x1871640292082944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935533.498522:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292082944:0@lo:400:kworker.0 00000100:00100000:0.0:1784935533.498947:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292081664:12345-0@lo:400:kworker.0 Request processed in 12190us (12687us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935533.499024:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1784935533.499180:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292081664:0@lo:400:kworker.0 00010000:00010000:2.0:1784935533.677140:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935534.000013:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935534.000040:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44435a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292083456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935534.000109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935534.000560:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292083456 00000100:00100000:3.0:1784935534.000569:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292083456 00000100:00100000:3.0:1784935534.000625:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784935534.000634:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292083456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935534.000666:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935534.000741:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292083456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935534.000749:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784935534.000910:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44435a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292083456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935534.001354:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292083584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935534.001408:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935534.001583:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292083584 00000100:00100000:0.0:1784935534.001589:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292083584 00000100:00100000:0.0:1784935534.001628:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784935534.001636:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292083584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784935534.001651:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935534.001698:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292083584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935534.001704:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784935534.001830:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292083584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935534.255456:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935534.255859:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273122432 00000100:00100000:2.0:1784935534.255870:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273122432 00000100:00100000:2.0:1784935534.256101:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 369 00000100:00100000:2.0:1784935534.256112:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2392:x1871640273122432:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935534.256193:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2392:x1871640273122432:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 83us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935534.256202:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 369 00000100:00100000:3.0:1784935534.261975:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935534.262128:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273122560 00000100:00100000:2.0:1784935534.262137:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273122560 00000100:00100000:2.0:1784935534.262208:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 235 00000100:00100000:2.0:1784935534.262218:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273122560:12345-192.168.203.28@tcp:400:kworker.0 00000100:00080000:1.0:1784935534.262296:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935534.262463:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273122560:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 245us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935534.262471:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 235 00000100:00100000:0.0:1784935534.277020:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935534.277062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935534.277099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935534.277132:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935534.277163:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273122816 00000100:00100000:0.0:1784935534.277163:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273122688 00000100:00100000:2.0:1784935534.277171:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273122816 00000100:00100000:0.0:1784935534.277171:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273122688 00000100:00100000:3.0:1784935534.277271:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273122944 00000100:00100000:3.0:1784935534.277275:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273122944 00000100:00100000:0.0:1784935534.277452:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273123072 00000100:00100000:0.0:1784935534.277455:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273123072 00000100:00080000:1.0:1784935534.280360:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935534.280371:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935534.280374:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935534.280431:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 236 00000100:00100000:1.0:1784935534.280453:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273122688:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935534.280544:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273122688:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 102us (3533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935534.280551:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 236 00000100:00100000:2.0:1784935534.281472:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 27 00000100:00100000:2.0:1784935534.281485:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2390:x1871640273122816:12345-192.168.203.28@tcp:9:kworker.0 00000020:00000080:2.0:1784935534.281511:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16768 00000100:00080000:2.0:1784935534.281521:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8d444285b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784935534.281565:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1784935534.281729:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+2:2390:x1871640273122816:12345-192.168.203.28@tcp:9:kworker.0 Request processed in 247us (4666us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935534.281736:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 27 00010000:00010000:2.0:1784935534.281769:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935534.282017:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 237 00000100:00100000:3.0:1784935534.282026:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273122944:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935534.282058:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273122944:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 34us (4959us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935534.282064:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 237 00000100:00100000:0.0:1784935534.283779:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 238 00000100:00100000:0.0:1784935534.283802:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273123072:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935534.283878:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273123072:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 79us (6745us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935534.283887:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 238 00000100:00100000:3.0:1784935534.509213:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784935534.509248:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292083712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784935534.509318:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935534.509556:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292083712 00000100:00100000:1.0:1784935534.509565:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292083712 00000100:00100000:1.0:1784935534.509635:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784935534.509646:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292083712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784935534.509679:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784935534.509725:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292083712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935534.509732:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784935534.509970:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292083712:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784935534.701418:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935535.725177:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935536.749555:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935537.069365:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292083840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784935537.069445:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935537.069626:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292083840 00000100:00100000:0.0:1784935537.069634:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292083840 00000100:00100000:0.0:1784935537.069684:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784935537.069693:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292083840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935537.069723:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784935537.069775:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292083840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935537.069781:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784935537.069919:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292083840:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784935537.773200:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935538.605228:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292084352:0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.605302:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935538.605362:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292084864:0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.605389:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935538.605429:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292085376:0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.605450:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935538.605474:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784935538.605480:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292084224:0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.605504:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935538.605522:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292084736:0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.605542:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935538.605558:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44431f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292085248:0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.605580:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935538.605629:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292084352 00000100:00100000:0.0:1784935538.605636:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292084352 00000100:00100000:0.0:1784935538.605685:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292084736 00000100:00100000:0.0:1784935538.605688:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292084736 00000100:00100000:0.0:1784935538.605716:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292085248 00000100:00100000:0.0:1784935538.605719:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292085248 00000100:00100000:0.0:1784935538.605736:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1784935538.605745:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292084352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.605802:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292084352:12345-0@lo:400:kworker.0 Request processed in 58us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.605809:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1784935538.605824:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1784935538.605829:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292084736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.605854:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292084736:12345-0@lo:400:kworker.0 Request processed in 25us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.605859:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1784935538.605868:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1784935538.605873:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292085248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.605893:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292085248:12345-0@lo:400:kworker.0 Request processed in 20us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.605899:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1784935538.605917:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292084864 00000100:00100000:0.0:1784935538.605920:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292084864 00000100:00100000:0.0:1784935538.605972:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292085376 00000100:00100000:0.0:1784935538.605975:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292085376 00000100:00100000:0.0:1784935538.605994:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784935538.606000:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292084864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.606029:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292084864:12345-0@lo:400:kworker.0 Request processed in 29us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.606042:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784935538.606054:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784935538.606060:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292085376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.606089:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292085376:12345-0@lo:400:kworker.0 Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.606094:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784935538.606115:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292084224 00000100:00100000:0.0:1784935538.606118:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292084224 00000100:00100000:0.0:1784935538.606144:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784935538.606150:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44410f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292084224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.606180:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44410f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292084224:12345-0@lo:400:kworker.0 Request processed in 30us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.606186:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1784935538.606209:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784935538.606212:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784935538.606214:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935538.606249:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292084224:0@lo:400:kworker.0 00010000:00080000:0.0:1784935538.606261:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4442956680 x1871640292084736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935538.606271:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292084736:0@lo:400:kworker.0 00010000:00080000:0.0:1784935538.606280:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44431f3100 x1871640292085248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935538.606288:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44431f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292085248:0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.606296:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292084352:0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.606312:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292084864:0@lo:400:kworker.0 00010000:00080000:0.0:1784935538.606319:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421ded80 x1871640292085376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935538.606327:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292085376:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.606683:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292083968:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.606723:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935538.606762:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292084480:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.606787:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935538.606813:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292084992:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.606835:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935538.606849:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292085504:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.606868:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935538.606885:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784935538.606891:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292084096:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.606912:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935538.606955:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292084608:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.606986:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935538.607002:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292085120:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.607022:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935538.607090:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292084480 00000100:00100000:2.0:1784935538.607095:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292084480 00000100:00100000:2.0:1784935538.607133:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784935538.607140:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292084480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935538.607178:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292084480:12345-0@lo:400:kworker.0 Request processed in 39us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935538.607184:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784935538.607306:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292085632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935538.607335:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935538.607360:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292085632 00000100:00100000:1.0:1784935538.607374:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292085632 00000100:00100000:1.0:1784935538.607422:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784935538.607428:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292085632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935538.607450:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935538.607495:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292085632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935538.607501:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1784935538.607530:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443586d80 x1871640292085632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935538.607545:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292085632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935538.607800:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292084480:0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.609282:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292083968 00000100:00100000:0.0:1784935538.609293:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292083968 00000100:00100000:0.0:1784935538.609352:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1784935538.609360:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292083968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.609460:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292083968:12345-0@lo:400:kworker.0 Request processed in 100us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.609468:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1784935538.609508:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292084096 00000100:00100000:0.0:1784935538.609514:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292084096 00000100:00100000:0.0:1784935538.609539:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292084608 00000100:00100000:0.0:1784935538.609542:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292084608 00000100:00100000:0.0:1784935538.609559:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292085120 00000100:00100000:0.0:1784935538.609562:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292085120 00000100:00100000:0.0:1784935538.609574:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784935538.609579:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292084096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.609613:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292084096:12345-0@lo:400:kworker.0 Request processed in 33us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.609619:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784935538.609630:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1784935538.609635:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292084608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.609661:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292084608:12345-0@lo:400:kworker.0 Request processed in 27us (2674us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.609685:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1784935538.609697:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1784935538.609703:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292085120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.609731:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292085120:12345-0@lo:400:kworker.0 Request processed in 28us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.609736:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1784935538.609762:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292084992 00000100:00100000:0.0:1784935538.609766:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292084992 00000100:00100000:0.0:1784935538.609788:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292085504 00000100:00100000:0.0:1784935538.609791:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292085504 00000100:00100000:0.0:1784935538.609806:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784935538.609812:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292084992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.609842:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292084992:12345-0@lo:400:kworker.0 Request processed in 31us (3007us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.609848:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784935538.609858:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784935538.609863:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292085504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935538.609887:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292085504:12345-0@lo:400:kworker.0 Request processed in 24us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935538.609892:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1784935538.609910:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784935538.609914:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784935538.609916:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935538.609958:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935538.609972:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292085760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935538.610007:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935538.610205:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292085760 00000100:00100000:3.0:1784935538.610210:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292085760 00000100:00100000:3.0:1784935538.610242:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784935538.610249:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292085760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784935538.610268:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935538.610313:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292085760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935538.610319:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784935538.610358:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292084096:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.610383:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292084608:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.610401:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292085120:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.610411:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292083968:0@lo:400:kworker.0 00000100:00100000:3.0:1784935538.610421:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292084992:0@lo:400:kworker.0 00010000:00080000:3.0:1784935538.610433:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44421dce00 x1871640292085504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935538.610443:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292085504:0@lo:400:kworker.0 00010000:00080000:2.0:1784935538.610571:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570540a80 x1871640292085760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935538.610586:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292085760:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784935538.797952:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935539.122784:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292085888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935539.123692:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935539.123768:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292085888 00000100:00100000:0.0:1784935539.123776:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292085888 00000100:00100000:0.0:1784935539.124299:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784935539.124311:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44431f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292085888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784935539.124341:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935539.124413:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44431f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292085888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935539.124420:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784935539.124469:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292085888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935539.126854:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44435a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292086016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935539.126925:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935539.127025:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292086016 00000100:00100000:3.0:1784935539.127032:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292086016 00000100:00100000:3.0:1784935539.127072:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784935539.127080:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292086016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935539.127104:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935539.127144:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292086016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935539.127150:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784935539.127191:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44435a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292086016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935539.375441:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935539.375473:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935539.375506:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935539.375611:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273123200 00000100:00100000:1.0:1784935539.375621:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273123200 00000100:00100000:1.0:1784935539.375672:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 371 00000100:00100000:1.0:1784935539.375683:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2391:x1871640273123200:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935539.375744:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2391:x1871640273123200:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 65us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935539.375751:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 371 00000100:00100000:3.0:1784935539.375947:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273123456 00000100:00100000:3.0:1784935539.375952:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273123456 00000100:00100000:3.0:1784935539.375997:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 245 00000100:00100000:3.0:1784935539.376005:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273123456:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935539.376040:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273123456:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 37us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935539.376046:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 245 00000100:00080000:1.0:1784935539.376504:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935539.376705:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935539.376733:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935539.376761:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273123712 00000100:00100000:1.0:1784935539.376767:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273123712 00000100:00100000:1.0:1784935539.376801:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273123328 00000100:00100000:1.0:1784935539.376804:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273123328 00000100:00100000:1.0:1784935539.376821:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273123584 00000100:00100000:1.0:1784935539.376824:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273123584 00000100:00100000:1.0:1784935539.376839:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 246 00000100:00100000:1.0:1784935539.376846:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273123712:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935539.376889:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273123712:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 43us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935539.376895:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 246 00000100:00100000:1.0:1784935539.376953:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 247 00000100:00100000:1.0:1784935539.376960:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273123328:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935539.376987:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273123328:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 28us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935539.376992:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 247 00000100:00100000:1.0:1784935539.377002:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 248 00000100:00100000:1.0:1784935539.377007:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273123584:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935539.377025:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273123584:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 18us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935539.377030:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 248 00000100:00080000:1.0:1784935539.377046:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935539.377048:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935539.635719:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292086144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784935539.635785:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935539.635888:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292086144 00000100:00100000:1.0:1784935539.635895:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292086144 00000100:00100000:1.0:1784935539.635961:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784935539.635970:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292086144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784935539.636002:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784935539.636042:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292086144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935539.636049:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784935539.636183:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292086144:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1784935539.638487:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:1.0:1784935539.638495:0:8431:0:(genops.c:906:class_export_put()) final put ffff8d444285e800/380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:3.0:1784935539.638743:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d444285e800/380c344d-145d-4a03-bcd4-797f2a6954a7 for lustre-OST0000 00000020:00000080:3.0:1784935539.638795:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d444285b000 for lustre-OST0000 00010000:00010000:3.0:1784935539.821084:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784935540.718824:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1784935540.720546:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784935540.845239:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935541.869887:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935542.192014:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935542.192050:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292086272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784935542.192117:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935542.192259:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292086272 00000100:00100000:3.0:1784935542.192267:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292086272 00000100:00100000:3.0:1784935542.192327:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784935542.192662:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292086272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784935542.192697:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784935542.192752:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292086272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 397us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935542.192759:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784935542.192805:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4442957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292086272:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784935542.893311:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935543.725317:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292086400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935543.725399:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935543.726378:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292086400 00000100:00100000:1.0:1784935543.726388:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292086400 00000100:00100000:1.0:1784935543.726443:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784935543.726465:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292086400:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935543.726483:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44435a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292086528:0@lo:400:kworker.0 00002000:00000024:1.0:1784935543.726493:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935543.726527:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935543.726533:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292086400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935543.726557:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1784935543.726578:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784935543.726604:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44435a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292086656:0@lo:400:kworker.0 00000100:00100000:1.0:1784935543.726635:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935543.726692:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292086784:0@lo:400:kworker.0 00000100:00100000:0.0:1784935543.726722:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935543.727023:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292086528 00000100:00100000:2.0:1784935543.727029:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292086528 00000100:00100000:2.0:1784935543.727063:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1784935543.727070:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292086528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935543.727111:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292086528:12345-0@lo:400:kworker.0 Request processed in 42us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935543.727126:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1784935543.727168:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292086912:0@lo:400:kworker.0 00000100:00100000:2.0:1784935543.727198:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935543.730346:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44435a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292086528:0@lo:400:kworker.0 00000100:00100000:3.0:1784935543.730373:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292087040:0@lo:400:kworker.0 00000100:00100000:3.0:1784935543.730724:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935543.731165:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292087552:0@lo:400:kworker.0 00000100:00100000:3.0:1784935543.731512:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935543.731570:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292088064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935543.731594:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935543.732012:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292086784 00000100:00100000:3.0:1784935543.732021:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292086784 00000100:00100000:3.0:1784935543.732375:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292087040 00000100:00100000:3.0:1784935543.732379:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292087040 00000100:00100000:3.0:1784935543.732398:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784935543.732406:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292086784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935543.732955:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292087168:0@lo:400:kworker.0 00000100:00100000:3.0:1784935543.732960:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292086784:12345-0@lo:400:kworker.0 Request processed in 551us (6233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935543.732981:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784935543.733002:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784935543.733008:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935543.733013:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292087040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935543.733040:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292087680:0@lo:400:kworker.0 00000100:00100000:3.0:1784935543.733725:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292087040:12345-0@lo:400:kworker.0 Request processed in 712us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935543.733735:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935543.733738:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784935543.733776:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292087552 00000100:00100000:3.0:1784935543.733782:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292087552 00000100:00100000:1.0:1784935543.733789:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292086656 00000100:00100000:1.0:1784935543.733795:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292086656 00000100:00100000:1.0:1784935543.734177:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292086912 00000100:00100000:1.0:1784935543.734181:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292086912 00000100:00100000:1.0:1784935543.734196:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292087168 00000100:00100000:1.0:1784935543.734199:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292087168 00000100:00100000:1.0:1784935543.734289:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292087680 00000100:00100000:1.0:1784935543.734293:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292087680 00000100:00100000:1.0:1784935543.734308:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1784935543.734315:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292086656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935543.734375:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292086656:12345-0@lo:400:kworker.0 Request processed in 60us (7739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935543.734382:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1784935543.734397:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784935543.734402:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292086912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935543.734447:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292086912:12345-0@lo:400:kworker.0 Request processed in 45us (7248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935543.734453:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784935543.734464:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784935543.734469:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292087168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935543.734493:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292087168:12345-0@lo:400:kworker.0 Request processed in 24us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935543.734498:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784935543.734509:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784935543.734517:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292087680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935543.734540:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784935543.734545:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292087680:12345-0@lo:400:kworker.0 Request processed in 29us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935543.734554:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292087552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935543.734554:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1784935543.734598:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292087552:12345-0@lo:400:kworker.0 Request processed in 49us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935543.734604:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784935543.734627:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292088064 00000100:00100000:3.0:1784935543.734643:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292088064 00000100:00080000:1.0:1784935543.734651:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935543.734657:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784935543.734660:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935543.734680:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784935543.734688:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292088064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935543.734697:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44435a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292086656:0@lo:400:kworker.0 00002000:00000024:3.0:1784935543.734705:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935543.734712:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292087168:0@lo:400:kworker.0 00000100:00100000:1.0:1784935543.734722:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292087680:0@lo:400:kworker.0 00000100:00100000:3.0:1784935543.734749:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292088064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935543.734757:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784935543.735107:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292086784:0@lo:400:kworker.0 00000100:00100000:0.0:1784935543.735116:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292087296:0@lo:400:kworker.0 00000100:00100000:0.0:1784935543.735149:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935543.735177:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292087808:0@lo:400:kworker.0 00000100:00100000:0.0:1784935543.735198:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935543.735223:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292086912:0@lo:400:kworker.0 00000100:00100000:2.0:1784935543.735232:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292087424:0@lo:400:kworker.0 00000100:00100000:2.0:1784935543.735263:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935543.735293:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292087424 00000100:00100000:2.0:1784935543.735297:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292087424 00000100:00100000:2.0:1784935543.735341:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784935543.735350:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292087424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935543.735352:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292087296 00000100:00100000:1.0:1784935543.735367:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292087296 00000100:00100000:1.0:1784935543.735402:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292087808 00000100:00100000:1.0:1784935543.735405:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292087808 00000100:00100000:2.0:1784935543.735410:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292087424:12345-0@lo:400:kworker.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935543.735419:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784935543.735432:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1784935543.735440:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292087296:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784935543.735444:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784935543.735449:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935543.735466:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292087424:0@lo:400:kworker.0 00000100:00100000:2.0:1784935543.735475:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292087936:0@lo:400:kworker.0 00000100:00100000:1.0:1784935543.735492:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292087296:12345-0@lo:400:kworker.0 Request processed in 52us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935543.735499:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1784935543.735508:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935543.735515:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1784935543.735522:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292087808:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1784935543.735547:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570540a80 x1871640292086400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935543.735556:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292087808:12345-0@lo:400:kworker.0 Request processed in 33us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935543.735569:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292086400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935543.735585:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1784935543.735632:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292087936 00000100:00100000:2.0:1784935543.735637:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292087936 00010000:00080000:1.0:1784935543.735638:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d7b80 x1871640292087808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935543.735650:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292087808:0@lo:400:kworker.0 00000100:00100000:2.0:1784935543.735669:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1784935543.735676:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443600000 x1871640292087296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935543.735687:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292087296:0@lo:400:kworker.0 00000100:00100000:2.0:1784935543.735692:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292087936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935543.735878:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292087936:12345-0@lo:400:kworker.0 Request processed in 190us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935543.735888:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:3.0:1784935543.735899:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4570542d80 x1871640292088064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935543.735915:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4570542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292088064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935543.735941:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292087040:0@lo:400:kworker.0 00010000:00080000:1.0:1784935543.735971:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d4a80 x1871640292087936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935543.735977:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292087552:0@lo:400:kworker.0 00000100:00100000:1.0:1784935543.735986:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292087936:0@lo:400:kworker.0 00010000:00010000:2.0:1784935543.917446:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935544.240471:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292088192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935544.240551:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935544.240621:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292088192 00000100:00100000:0.0:1784935544.240628:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292088192 00000100:00100000:0.0:1784935544.240668:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784935544.240676:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292088192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784935544.240704:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935544.240745:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292088192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935544.240752:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784935544.240794:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292088192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935544.242232:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935544.242251:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44429db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292088320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935544.242305:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935544.242550:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292088320 00000100:00100000:1.0:1784935544.242556:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292088320 00000100:00100000:1.0:1784935544.242603:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784935544.242610:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292088320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784935544.242630:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935544.242671:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292088320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935544.242687:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784935544.242760:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44429db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292088320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935544.494801:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935544.494833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935544.494850:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935544.494866:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935544.494883:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935544.497311:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273123840 00000100:00100000:1.0:1784935544.497325:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273123840 00000100:00100000:1.0:1784935544.497394:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 373 00000100:00100000:1.0:1784935544.497405:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2392:x1871640273123840:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935544.498076:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2392:x1871640273123840:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 669us (3281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935544.498087:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 373 00000100:00100000:1.0:1784935544.498131:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273124096 00000100:00100000:1.0:1784935544.498136:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273124096 00000100:00100000:1.0:1784935544.498175:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273124352 00000100:00100000:1.0:1784935544.498178:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273124352 00000100:00100000:1.0:1784935544.498192:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273123968 00000100:00100000:1.0:1784935544.498194:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273123968 00000100:00100000:1.0:1784935544.498205:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273124224 00000100:00100000:1.0:1784935544.498208:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273124224 00000100:00100000:1.0:1784935544.498221:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 255 00000100:00100000:1.0:1784935544.498227:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273124096:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935544.498262:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273124096:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 35us (3428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935544.498268:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 255 00000100:00100000:1.0:1784935544.498280:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 256 00000100:00100000:1.0:1784935544.498286:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273124352:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935544.498310:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273124352:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 24us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935544.498316:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 256 00000100:00100000:1.0:1784935544.498340:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 257 00000100:00100000:1.0:1784935544.498346:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273123968:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935544.498391:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2392:x1871640273123968:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 45us (3524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935544.498398:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 257 00000100:00100000:1.0:1784935544.498410:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 258 00000100:00100000:1.0:1784935544.498416:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273124224:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935544.498451:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2392:x1871640273124224:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 24us (3555us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935544.498458:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 258 00000100:00080000:2.0:1784935544.498730:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784935544.498735:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1784935544.691749:0:14064:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:25:43 (1784935543) 00000100:00100000:0.0:1784935544.751235:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784935544.760146:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44435a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292088448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935544.760216:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935544.761206:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292088448 00000100:00100000:2.0:1784935544.761217:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292088448 00000100:00100000:2.0:1784935544.761278:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784935544.761299:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292088448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784935544.761337:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784935544.761407:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292088448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935544.761414:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784935544.761462:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44435a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292088448:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784935544.941229:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935545.966613:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935546.519623:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935546.519755:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273124480 00000100:00100000:2.0:1784935546.519765:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273124480 00000100:00100000:2.0:1784935546.519853:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 40 00000100:00100000:2.0:1784935546.519864:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44429db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:11057:x1871640273124480:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784935546.519896:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935546.519916:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a916 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935546.520002:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b1684f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935546.520016:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b1684f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935546.520029:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b1684f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935546.520073:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784935546.520077:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935546.520111:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b1684f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935546.520135:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a916 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935546.520153:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b1684f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a916 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935546.520162:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145800) 00010000:00010000:2.0:1784935546.520165:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784935546.520168:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201000, rc 0) 00000100:00100000:2.0:1784935546.520226:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44429db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:11057:x1871640273124480:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 364us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935546.520233:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 40 00000100:00080000:0.0:1784935546.520303:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935546.533706:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935546.535296:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273124608 00000100:00100000:1.0:1784935546.535309:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273124608 00000100:00100000:1.0:1784935546.535409:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 41 00000100:00100000:1.0:1784935546.535427:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:11058:x1871640273124608:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935546.535448:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935546.535477:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b16856 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a91d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.535550:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b1685d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.535565:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b1685d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.535576:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b1685d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.535608:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16864 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.535840:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16864 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.535850:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16864 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.535963:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c600/0x857e02f4e0b1686b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.535973:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c600/0x857e02f4e0b1686b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.535980:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c600/0x857e02f4e0b1686b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935546.536033:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784935546.536038:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935546.536068:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c600/0x857e02f4e0b1686b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536079:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b1685d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536093:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b1685d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536100:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b1685d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536134:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6cc00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935546.536139:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b1685d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536145:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b1685d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536163:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145800) 00010000:00010000:1.0:1784935546.536166:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935546.536170:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b1685d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536176:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b1685d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536199:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16864 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536204:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16864 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536210:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16864 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536215:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6ce00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935546.536218:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16864 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536235:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16864 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536259:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d454918db00) 00010000:00010000:1.0:1784935546.536262:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935546.536265:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16864 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536271:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16864 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536316:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b16856 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a91d expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536458:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c600/0x857e02f4e0b1686b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a91d expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.536469:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d454918d500) 00010000:00010000:1.0:1784935546.536471:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784935546.536473:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6c600, rc 0) 00000100:00100000:1.0:1784935546.536585:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:11058:x1871640273124608:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 1166us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935546.536592:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 41 00000100:00100000:3.0:1784935546.546053:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935546.546156:0:6537:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273124736 00000100:00100000:1.0:1784935546.546166:0:6537:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273124736 00000100:00100000:1.0:1784935546.546231:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:1.0:1784935546.546241:0:6537:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:11058:x1871640273124736:12345-192.168.203.28@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784935546.546336:0:6537:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:11058:x1871640273124736:12345-192.168.203.28@tcp:900:lhsmtool_posix.0 Request processed in 96us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935546.546352:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:2.0:1784935546.550838:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935546.550970:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273124992 00000100:00100000:1.0:1784935546.550980:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273124992 00000100:00100000:1.0:1784935546.551091:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 42 00000100:00100000:1.0:1784935546.551102:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:11058:x1871640273124992:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935546.551124:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935546.551143:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b16872 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a924 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551212:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16879 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551227:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16879 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551239:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16879 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551320:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16880 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551328:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16880 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551334:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16880 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551440:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b16887 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551449:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b16887 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551477:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b16887 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935546.551488:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1784935546.551567:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16879 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551575:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16879 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551581:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16879 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551587:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6ce00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935546.551591:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16879 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551598:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16879 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551609:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d454918d500) 00010000:00010000:1.0:1784935546.551612:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935546.551616:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16879 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551621:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b16879 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551635:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16880 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551640:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16880 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551652:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16880 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551657:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6cc00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935546.551660:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16880 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551665:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16880 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551675:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d454918db00) 00010000:00010000:1.0:1784935546.551677:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935546.551679:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16880 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935546.551683:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16880 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935546.556906:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b16872 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a924 expref: 10 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935546.556960:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b16887 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a924 expref: 9 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935546.556970:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:0.0:1784935546.556973:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935546.556976:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6de00, rc 0) 00000100:00100000:0.0:1784935546.557060:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+9:11058:x1871640273124992:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 5958us (6228us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1784935546.557083:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 42 00000100:00100000:3.0:1784935546.560455:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935546.560669:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273125120 00000100:00100000:1.0:1784935546.560678:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273125120 00000100:00100000:1.0:1784935546.560739:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 43 00000100:00100000:1.0:1784935546.560748:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+9:11058:x1871640273125120:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784935546.560851:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+9:11058:x1871640273125120:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 Request processed in 104us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935546.560859:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 43 00000100:00100000:1.0:1784935546.571242:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935546.571353:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273125248 00000100:00100000:2.0:1784935546.571362:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273125248 00000100:00100000:2.0:1784935546.571433:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 44 00000100:00100000:2.0:1784935546.571444:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:11058:x1871640273125248:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1784935546.571724:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1784935546.573127:0:6526:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1642us 00000100:00100000:2.0:1784935546.604069:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:11058:x1871640273125248:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 Request processed in 32616us (32826us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935546.604083:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 44 00000040:00080000:2.0:1784935546.865712:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1784935546.867284:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784935546.991127:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935547.313019:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935547.313043:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292088576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935547.313109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935547.313476:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292088576 00000100:00100000:1.0:1784935547.313493:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292088576 00000100:00100000:1.0:1784935547.313549:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784935547.313557:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292088576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784935547.313592:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784935547.313642:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292088576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935547.313649:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784935547.314005:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292088576:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784935548.019188:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935548.660270:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935548.660730:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273125376 00000100:00100000:0.0:1784935548.660740:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273125376 00000100:00100000:0.0:1784935548.660832:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 45 00000100:00100000:0.0:1784935548.660844:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4581d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+9:11100:x1871640273125376:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935548.660865:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935548.660884:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b16895 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a92b expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.660974:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1689c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.660988:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1689c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.660999:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1689c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661011:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661017:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661023:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661059:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1689c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661076:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1689c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661083:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1689c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661089:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935548.661093:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1689c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661101:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1689c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661118:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145800) 00010000:00010000:0.0:1784935548.661121:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:1.0:1784935548.661172:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784935548.661201:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1689c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661207:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b1689c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661218:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661224:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661229:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661233:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935548.661241:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661247:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661255:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d45705a8d00) 00010000:00010000:0.0:1784935548.661257:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935548.661259:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661265:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661296:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b16895 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a92b expref: 10 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661308:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145800) 00010000:00010000:0.0:1784935548.661310:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935548.661314:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b16895 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a92b expref: 10 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.661322:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699200, rc 0) 00000100:00100000:0.0:1784935548.661393:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4581d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+9:11100:x1871640273125376:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 552us (1129us total) trans 0 rc 301/301 00000100:00100000:0.0:1784935548.661400:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 45 00000100:00100000:3.0:1784935548.672740:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935548.673017:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273125632 00000100:00100000:0.0:1784935548.673026:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273125632 00000100:00100000:0.0:1784935548.673078:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 46 00000100:00100000:0.0:1784935548.673089:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+9:11100:x1871640273125632:12345-192.168.203.28@tcp:36:lfs.0 00010000:00010000:0.0:1784935548.673167:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935548.673191:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b1684f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a916 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673208:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145800) 00010000:00010000:0.0:1784935548.673218:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784935548.673275:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673287:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673303:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673313:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673319:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673325:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673738:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673748:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673756:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784935548.673779:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000002162c85 reply state 000000003dcd3d59 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673791:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673797:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935548.673799:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784935548.673802:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784935548.673807:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784935548.673813:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673819:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168aa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673825:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673830:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935548.673834:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673841:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673850:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:0.0:1784935548.673852:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935548.673856:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168aa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673872:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784935548.673891:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000002162c85 reply state 000000003dcd3d59 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673899:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.673904:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d45705a8c00) 00010000:00010000:0.0:1784935548.673907:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784935548.673909:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784935548.674062:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+10:11100:x1871640273125632:12345-192.168.203.28@tcp:36:lfs.0 Request processed in 973us (1328us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1784935548.674070:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 46 00000100:00100000:1.0:1784935548.768814:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935548.768882:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273125760 00000100:00100000:2.0:1784935548.768893:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273125760 00000100:00100000:2.0:1784935548.769044:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 47 00000100:00100000:2.0:1784935548.769055:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+10:11108:x1871640273125760:12345-192.168.203.28@tcp:101:lctl.0 00010000:00010000:2.0:1784935548.769078:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935548.769099:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b168bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a932 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935548.769214:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b168c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935548.769228:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b168c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935548.769254:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b168c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935548.769293:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784935548.769296:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935548.769337:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b168c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935548.769357:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b168bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a932 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935548.769375:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b168c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a932 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935548.769383:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:2.0:1784935548.769386:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784935548.769389:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201800, rc 0) 00000100:00100000:2.0:1784935548.769510:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+11:11108:x1871640273125760:12345-192.168.203.28@tcp:101:lctl.0 Request processed in 397us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935548.769518:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 47 00000100:00100000:1.0:1784935548.811139:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935548.811234:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273125888 00000100:00100000:0.0:1784935548.811245:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273125888 00000100:00100000:0.0:1784935548.811315:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 48 00000100:00100000:0.0:1784935548.811325:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+11:11114:x1871640273125888:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:0.0:1784935548.811353:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935548.811373:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a939 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811433:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b168d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811446:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b168d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811485:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b168d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811495:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811502:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811508:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811575:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b168e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811583:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b168e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811589:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b168e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935548.811619:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784935548.811623:0:7797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935548.811658:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b168e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811669:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b168d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811675:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b168d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811691:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b168d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811698:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935548.811702:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b168d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811709:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b168d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811721:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:0.0:1784935548.811724:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935548.811728:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b168d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811734:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b168d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811747:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811753:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811758:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811763:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935548.811765:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811780:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811788:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d45705a8c00) 00010000:00010000:0.0:1784935548.811791:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935548.811794:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811799:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b168db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811823:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b168cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a939 expref: 13 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811835:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b168e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a939 expref: 12 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.811844:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935548.811847:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784935548.811849:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698800, rc 0) 00000100:00100000:0.0:1784935548.811907:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+12:11114:x1871640273125888:12345-192.168.203.28@tcp:101:bash.0 Request processed in 584us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935548.811914:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 48 00000100:00100000:3.0:1784935548.814201:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935548.814407:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273126144 00000100:00100000:1.0:1784935548.814416:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273126144 00000100:00100000:1.0:1784935548.814970:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 49 00000100:00100000:1.0:1784935548.814983:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+12:11114:x1871640273126144:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935548.815005:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935548.815025:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b168e9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a940 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.815124:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b168f0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.815136:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b168f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.815147:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b168f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.815201:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.815226:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.815233:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784935548.817181:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1784935548.817578:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b168fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817592:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b168fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817603:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b168fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817637:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b168f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817643:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b168f0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817649:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b168f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817654:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6d600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935548.817658:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b168f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817664:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b168f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817692:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:1.0:1784935548.817695:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935548.817699:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b168f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817705:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b168f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784935548.817718:0:6525:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000964fab38 reply state 0000000040cba540 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817729:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817735:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d457d166800) 00010000:00010000:1.0:1784935548.817738:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784935548.817741:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784935548.817774:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b168e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a940 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817789:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b168fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a940 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.817796:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166c00) 00010000:00010000:1.0:1784935548.817799:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935548.817801:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6cc00, rc 0) 00000100:00100000:1.0:1784935548.817874:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+15:11114:x1871640273126144:12345-192.168.203.28@tcp:101:bash.0 Request processed in 2894us (3681us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1784935548.817884:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 49 00000100:00100000:1.0:1784935548.822155:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935548.822237:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273126272 00000100:00100000:2.0:1784935548.822248:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273126272 00000100:00100000:2.0:1784935548.822308:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 28 00000100:00100000:2.0:1784935548.822316:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1871640273126272:12345-192.168.203.28@tcp:8:bash.0 00010000:00080000:2.0:1784935548.822358:0:8440:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp t0 exp 0000000000000000 cur 368 last 0 00000020:00000080:2.0:1784935548.822386:0:8440:0:(genops.c:1406:class_connect()) connect: client 380c344d-145d-4a03-bcd4-797f2a6954a7, cookie 0x857e02f4e0b1690c 00002000:00100000:2.0:1784935548.822399:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 380c344d-145d-4a03-bcd4-797f2a6954a7/ffff8d455126d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784935548.822429:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784935548.822690:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784935548.822718:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784935548.822790:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2390:x1871640273126272:12345-192.168.203.28@tcp:8:bash.0 Request processed in 472us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935548.822799:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 28 00000100:00100000:3.0:1784935548.824624:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935548.830140:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273126400 00000100:00100000:1.0:1784935548.830156:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273126400 00000100:00100000:1.0:1784935548.830236:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 29 00000100:00100000:1.0:1784935548.830247:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:0:x1871640273126400:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935548.830264:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935548.830289:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfdce7a2/0x857e02f4e0b16913 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a947 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784935548.830333:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935548.830355:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1784935548.830361:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935548.830370:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdce7a2/0x857e02f4e0b16913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a947 expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.830391:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfdce7a2/0x857e02f4e0b16913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a947 expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935548.830406:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6d400, rc 0) 00000100:00100000:1.0:1784935548.830497:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:0:x1871640273126400:12345-192.168.203.28@tcp:101:bash.0 Request processed in 252us (5881us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935548.830505:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 29 00000100:00080000:0.0:1784935548.831454:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935548.839396:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935548.839775:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273126528 00000100:00100000:2.0:1784935548.839785:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273126528 00000100:00100000:2.0:1784935548.839844:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 30 00000100:00100000:2.0:1784935548.839853:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:11114:x1871640273126528:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:2.0:1784935548.839873:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935548.839894:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a94e expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935548.839969:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfdce7a2/0x857e02f4e0b16913 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a947 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935548.839980:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935548.839984:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935548.839998:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935548.840033:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfdce7a2/0x857e02f4e0b16913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a947 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935548.840046:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfdce7a2/0x857e02f4e0b16913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a947 expref: 8 pid: 8441 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935548.840073:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1871640292088704:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935548.840169:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45436ffcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935548.844274:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1871640292088704:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935548.845683:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935548.845730:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273126656 00000100:00100000:3.0:1784935548.845739:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273126656 00010000:00010000:3.0:1784935548.845778:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdce7a2/0x857e02f4e0b16913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a947 expref: 9 pid: 8441 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935548.845812:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 52 00000100:00100000:3.0:1784935548.845820:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45729c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2391:x1871640273126656:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935548.845835:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935548.845856:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfdce7a2/0x857e02f4e0b16913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a947 expref: 9 pid: 8441 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935548.845887:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfdce7a2/0x857e02f4e0b16913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a947 expref: 9 pid: 8441 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935548.845914:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfdce7a2/0x857e02f4e0b16913 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a947 expref: 9 pid: 8441 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935548.845950:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935548.845955:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935548.845963:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935548.845974:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935548.846011:0:9527:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935548.846026:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443664700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9527:1871640292088832:192.168.203.28@tcp:105: 00000100:00100000:3.0:1784935548.846101:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f1c00 going to sleep for 11 seconds 00010000:00010000:2.0:1784935548.846180:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935548.846196:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200600, rc 0) 00000100:00100000:2.0:1784935548.846247:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+8:11114:x1871640273126528:12345-192.168.203.28@tcp:101:bash.0 Request processed in 6395us (6863us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935548.846320:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 30 00000100:00100000:2.0:1784935548.846400:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292088960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935548.846408:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292089088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935548.846510:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935548.846611:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935548.846685:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292089600:0@lo:400:kworker.0 00000100:00100000:2.0:1784935548.846723:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935548.846733:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292089216:0@lo:400:kworker.0 00000100:00100000:2.0:1784935548.846749:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292090112:0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.846772:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935548.846792:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292089728:0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.846829:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935548.846849:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935548.846852:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292090240:0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.846883:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935548.846962:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292088960 00000100:00100000:1.0:1784935548.846968:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292088960 00000100:00100000:1.0:1784935548.847008:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292089088 00000100:00100000:1.0:1784935548.847011:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292089088 00000100:00100000:1.0:1784935548.847035:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784935548.847042:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292088960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935548.847060:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935548.847115:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784935548.847123:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292089088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784935548.847133:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935548.847360:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292088960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 318us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935548.847368:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784935548.847397:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292089216 00000100:00100000:1.0:1784935548.847401:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292089216 00000100:00100000:1.0:1784935548.847431:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1784935548.847438:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3650:x1871640292089216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935548.847578:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292089088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 455us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935548.847595:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784935548.847617:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292090112 00000100:00100000:2.0:1784935548.847622:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292090112 00000100:00100000:2.0:1784935548.847645:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292090240 00000100:00100000:2.0:1784935548.847648:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292090240 00000100:00100000:2.0:1784935548.847666:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784935548.847672:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292090112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935548.847706:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292090112:12345-0@lo:400:kworker.0 Request processed in 34us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935548.847712:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784935548.847725:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784935548.847730:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292090240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935548.848008:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292090112:0@lo:400:kworker.0 00000100:00100000:3.0:1784935548.848028:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44419ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292089088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935548.848094:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292090240:12345-0@lo:400:kworker.0 Request processed in 363us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935548.848101:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784935548.848120:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292089600 00000100:00100000:2.0:1784935548.848124:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292089600 00000100:00100000:2.0:1784935548.848158:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1784935548.848164:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292089600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935548.848206:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292089600:12345-0@lo:400:kworker.0 Request processed in 42us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935548.848212:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1784935548.848242:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292089600:0@lo:400:kworker.0 00000100:00100000:1.0:1784935548.848367:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3650:x1871640292089216:12345-0@lo:400:kworker.0 Request processed in 929us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935548.848375:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1784935548.848484:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292090240:0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.848503:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292089216:0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.848533:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292089728 00000100:00100000:0.0:1784935548.848537:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292089728 00000100:00100000:0.0:1784935548.848565:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784935548.848573:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292089728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.848624:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292089728:12345-0@lo:400:kworker.0 Request processed in 53us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935548.848630:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784935548.848656:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292089344:0@lo:400:kworker.0 00000100:00100000:3.0:1784935548.848661:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292089728:0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.848690:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935548.848716:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292089856:0@lo:400:kworker.0 00000100:00100000:2.0:1784935548.848740:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292089472:0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.848740:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935548.848760:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292090368:0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.848781:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784935548.848809:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784935548.848814:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784935548.848893:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292089344 00000100:00100000:1.0:1784935548.848897:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292089344 00000100:00100000:1.0:1784935548.848949:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292089856 00000100:00100000:1.0:1784935548.848953:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292089856 00000100:00100000:0.0:1784935548.848985:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292090368 00000100:00100000:1.0:1784935548.848988:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784935548.848995:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292089344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935548.849032:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292089344:12345-0@lo:400:kworker.0 Request processed in 38us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935548.849038:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784935548.849051:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292090368 00000100:00100000:1.0:1784935548.849052:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1784935548.849065:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292089856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.849082:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784935548.849088:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292090368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.849119:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292090368:12345-0@lo:400:kworker.0 Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935548.849134:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784935548.849163:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292089344:0@lo:400:kworker.0 00000100:00100000:0.0:1784935548.849172:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292090368:0@lo:400:kworker.0 00000100:00080000:0.0:1784935548.849197:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935548.849704:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935548.849741:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292089984:0@lo:400:kworker.0 00000100:00100000:3.0:1784935548.849870:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292089472 00000100:00100000:3.0:1784935548.849882:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292089472 00000100:00100000:3.0:1784935548.849923:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784935548.849950:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292089472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935548.849992:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292089472:12345-0@lo:400:kworker.0 Request processed in 43us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935548.849999:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784935548.850066:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935548.850095:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d45412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292090496:0@lo:400:kworker.0 00000100:00100000:2.0:1784935548.850117:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935548.850158:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292088960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784935548.850180:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292089472:0@lo:400:kworker.0 00000100:00100000:3.0:1784935548.850380:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292089984 00000100:00100000:3.0:1784935548.850384:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292089984 00000100:00100000:0.0:1784935548.850397:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292090496 00000100:00100000:0.0:1784935548.850403:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292090496 00000100:00080000:1.0:1784935548.850526:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935548.850559:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1784935548.850568:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292089984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935548.850721:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292089984:12345-0@lo:400:kworker.0 Request processed in 155us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935548.850728:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1784935548.850742:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1784935548.850748:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292090496:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1784935548.850917:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444365f480 x1871640292089984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935548.850958:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292089984:0@lo:400:kworker.0 00000100:00100000:3.0:1784935548.851057:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292090496:12345-0@lo:400:kworker.0 Request processed in 309us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935548.851064:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00010000:00080000:1.0:1784935548.851121:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d45412eb100 x1871640292090496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935548.851130:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d45412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292090496:0@lo:400:kworker.0 00000100:00100000:2.0:1784935548.852867:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292089856:12345-0@lo:400:kworker.0 Request processed in 3799us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935548.852880:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1784935548.853529:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935548.853581:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443664700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9527:1871640292088832:192.168.203.28@tcp:105: 00010000:00010000:2.0:1784935548.853601:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935548.853641:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45729c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273126656:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 7821us (7964us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935548.853650:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 52 00000100:00100000:2.0:1784935548.853809:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292089856:0@lo:400:kworker.0 00000100:00100000:2.0:1784935548.853839:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273126912 00000100:00100000:2.0:1784935548.853845:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273126912 00000100:00100000:2.0:1784935548.853894:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 6 00000100:00100000:2.0:1784935548.853902:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+15:11114:x1871640273126912:12345-192.168.203.28@tcp:35:bash.0 00000100:00100000:2.0:1784935548.854157:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+16:11114:x1871640273126912:12345-192.168.203.28@tcp:35:bash.0 Request processed in 255us (631us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1784935548.854164:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 6 00000100:00100000:2.0:1784935548.935422:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935548.935727:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273127168 00000100:00100000:0.0:1784935548.935737:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273127168 00000100:00100000:0.0:1784935548.935839:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:0.0:1784935548.936039:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+16:11124:x1871640273127168:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935548.936063:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935548.936093:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a955 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935548.936187:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784935548.936281:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16921 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a955 expref: 18 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.936295:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:0.0:1784935548.936298:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784935548.936302:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a955 expref: 18 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935548.936315:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698c00, rc 0) 00000100:00100000:0.0:1784935548.936391:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+17:11124:x1871640273127168:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 543us (978us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1784935548.936410:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:2.0:1784935548.941270:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935548.941350:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273127424 00000100:00100000:1.0:1784935548.941360:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273127424 00000100:00100000:1.0:1784935548.941416:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:1.0:1784935548.941426:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+17:11124:x1871640273127424:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:1.0:1784935548.941648:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+18:11124:x1871640273127424:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 222us (387us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1784935548.941656:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 7 00010000:00010000:2.0:1784935549.037555:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935549.050643:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935549.053672:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273127552 00000100:00100000:0.0:1784935549.053691:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273127552 00000100:00100000:0.0:1784935549.053787:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00100000:0.0:1784935549.053798:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+18:11130:x1871640273127552:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935549.053822:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935549.053844:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1692f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a95c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.053911:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16936 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.053954:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.053968:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935549.054026:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784935549.054031:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935549.054052:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.054078:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1692f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a95c expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.054098:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16936 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a95c expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.054126:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935549.054129:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784935549.054133:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699400, rc 0) 00000100:00100000:0.0:1784935549.054347:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+19:11130:x1871640273127552:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 549us (3712us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935549.054354:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00100000:3.0:1784935549.057256:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935549.057475:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273127808 00000100:00100000:2.0:1784935549.057485:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273127808 00000100:00100000:2.0:1784935549.057558:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 52 00000100:00100000:2.0:1784935549.057640:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44419ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+19:11130:x1871640273127808:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935549.057663:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935549.057683:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b1693d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a963 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.058033:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16944 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.058048:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.058061:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935549.058073:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784935549.058184:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b1693d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a963 expref: 22 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.058204:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16944 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a963 expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.058213:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166c00) 00010000:00010000:2.0:1784935549.058217:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935549.058221:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201e00, rc 0) 00000100:00100000:2.0:1784935549.058286:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44419ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+21:11130:x1871640273127808:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 719us (1042us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1784935549.058317:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 52 00000100:00100000:0.0:1784935549.064055:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935549.064108:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273128064 00000100:00100000:2.0:1784935549.064119:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273128064 00000100:00100000:2.0:1784935549.064178:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:2.0:1784935549.064188:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+21:11130:x1871640273128064:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935549.064212:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935549.064233:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16952 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a96a expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.064447:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16959 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.064464:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16959 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.064474:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16959 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935549.064485:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784935549.064605:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16952 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a96a expref: 24 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.064623:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16959 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a96a expref: 23 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.064631:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166c00) 00010000:00010000:2.0:1784935549.064634:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784935549.064638:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200a00, rc 0) 00000100:00100000:2.0:1784935549.064712:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+23:11130:x1871640273128064:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 525us (665us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1784935549.064719:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:3.0:1784935549.065278:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935549.065713:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273128192 00000100:00100000:1.0:1784935549.065720:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273128192 00000100:00100000:1.0:1784935549.065807:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 3 00000100:00100000:1.0:1784935549.065816:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+23:2394:x1871640273128192:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935549.065828:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935549.065848:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16944 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a963 expref: 23 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.065863:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166c00) 00010000:00010000:1.0:1784935549.065867:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935549.065911:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+22:2394:x1871640273128192:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 96us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935549.065918:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 3 00000100:00100000:2.0:1784935549.078661:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935549.078768:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273128320 00000100:00100000:1.0:1784935549.078849:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273128320 00000100:00100000:1.0:1784935549.080019:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 31 00000100:00100000:1.0:1784935549.080037:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273128320:12345-192.168.203.28@tcp:1:lfs.0 00010000:00010000:1.0:1784935549.080083:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.080106:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.080116:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935549.080120:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784935549.080125:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.080167:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.080182:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 7 pid: 8440 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935549.080197:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1871640292090624:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935549.080310:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4544f9a780 going to sleep for 11 seconds 00000100:00100000:0.0:1784935549.085839:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935549.086348:0:8444:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273128448 00000100:00100000:2.0:1784935549.086360:0:8444:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273128448 00002000:00100000:2.0:1784935549.086404:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8d4443593480 x1871640273128448/t0(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:45/0 lens 504/0 e 0 to 0 dl 1784935560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784935549.086415:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443593480 with x1871640273128448 ext(0->12) 00010000:00010000:2.0:1784935549.086424:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 8 pid: 8440 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.086441:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 8 pid: 8440 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935549.086448:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4443593480 00000100:00100000:2.0:1784935549.086485:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 0 00000100:00100000:2.0:1784935549.086494:0:8444:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2392:x1871640273128448:12345-192.168.203.28@tcp:4:lfs.0 00000100:00100000:1.0:1784935549.087101:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1871640292090624:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935549.087125:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1784935549.089837:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000100:00100000:2.0:1784935549.091059:0:8444:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2392:x1871640273128448:12345-192.168.203.28@tcp:4:lfs.0 Request processed in 4557us (5221us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784935549.091072:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 0 00002000:00100000:2.0:1784935549.091084:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8d4443593480 x1871640273128448/t4294967300(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:45/0 lens 504/448 e 0 to 0 dl 1784935560 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784935549.091095:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443593480 with x1871640273128448 ext(0->12) 00010000:00010000:2.0:1784935549.091105:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 9 pid: 8440 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.091149:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 9 pid: 8440 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935549.091158:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4443593480 00000100:00100000:3.0:1784935549.096432:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935549.096884:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273128576 00000100:00100000:0.0:1784935549.096894:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273128576 00010000:00010000:0.0:1784935549.096978:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 9 pid: 8440 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935549.097031:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:0.0:1784935549.097041:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2391:x1871640273128576:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935549.097058:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784935549.097075:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784935549.097078:0:6512:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1784935549 00002000:00010000:0.0:1784935549.097080:0:6512:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1784935549 00002000:00010000:0.0:1784935549.097082:0:6512:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1784935549 00002000:00010000:0.0:1784935549.097085:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784935549.097091:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 9 pid: 8440 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.097142:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 9 pid: 8440 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.097173:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0c4517b/0x857e02f4e0b1691a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a94e expref: 9 pid: 8440 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.097195:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784935549.097200:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784935549.097207:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.097217:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.097243:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935549.097314:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273128576:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 275us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935549.097322:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 53 00010000:00010000:1.0:1784935549.098581:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.098598:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.098626:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.098635:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.098644:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.098652:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6d600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935549.098656:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.098665:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.098682:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.098709:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078182cf6/0x857e02f4e0b16967 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935549.098812:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273128320:12345-192.168.203.28@tcp:1:lfs.0 Request processed in 18779us (20274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935549.098821:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 31 00000100:00100000:3.0:1784935549.107628:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935549.107709:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273128832 00000100:00100000:1.0:1784935549.107719:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273128832 00000100:00100000:1.0:1784935549.107885:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 8 00000100:00100000:1.0:1784935549.107897:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+22:11130:x1871640273128832:12345-192.168.203.28@tcp:35:lfs.0 00000004:00010000:1.0:1784935549.108003:0:6528:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16959 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a96a expref: 22 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784935549.108248:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1784935549.108296:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1784935549.108583:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1784935549.108619:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.108635:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b168fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a940 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.108645:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.108680:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b168fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a940 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.108705:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b168fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a940 expref: 26 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935549.108719:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6528:1871640292090752:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935549.108811:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45430f90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935549.115446:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6528:1871640292090752:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935549.115525:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935549.115779:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935549.116129:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273128960 00000100:00100000:3.0:1784935549.116136:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273128960 00010000:00010000:3.0:1784935549.116169:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b168fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a940 expref: 27 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935549.116222:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 54 00000100:00100000:3.0:1784935549.116230:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+27:2391:x1871640273128960:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935549.116245:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935549.116251:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b168fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a940 expref: 27 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.116262:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b168fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a940 expref: 27 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.116283:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b168fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a940 expref: 27 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.116549:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166c00) 00010000:00010000:3.0:1784935549.116555:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.116564:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.116570:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.116625:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935549.116687:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+26:2391:x1871640273128960:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 456us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935549.116694:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 54 00010000:00010000:1.0:1784935549.118100:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.118111:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784935549.118206:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1784935549.118310:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1784935549.118610:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1871640292090880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784935549.118674:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935549.118751:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45430f9180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935549.118793:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292090880 00000100:00100000:0.0:1784935549.118801:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292090880 00000100:00100000:0.0:1784935549.118881:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784935549.118890:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1871640292090880:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784935549.119102:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1871640292090880:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 213us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935549.119125:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784935549.119271:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1871640292090880:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784935549.119433:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1784935549.119482:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1871640292091008:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784935549.119510:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935549.119582:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4544f9a780 going to sleep for 11 seconds 00000100:00100000:0.0:1784935549.119668:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292091008 00000100:00100000:0.0:1784935549.119672:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292091008 00000100:00100000:0.0:1784935549.119702:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784935549.119708:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1871640292091008:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784935549.119803:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6528:x1871640292091008:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 95us (291us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1784935549.119811:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784935549.119882:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1871640292091008:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784935549.119925:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1784935549.119991:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.120001:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.120007:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.120013:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6d600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935549.120018:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.120024:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.120041:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166c00) 00010000:00010000:1.0:1784935549.120044:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784935549.120048:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.120053:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1696e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784935549.120138:0:6528:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784935549.120195:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1784935549.120206:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368370277894ns, next at 369370275788ns, rc = 0 00000001:00080000:1.0:1784935549.120212:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1784935549.120234:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166c00) 00010000:00010000:1.0:1784935549.120238:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784935549.120252:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16959 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a96a expref: 30 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935549.120372:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+29:11130:x1871640273128832:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 12478us (12756us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1784935549.120380:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 8 00000020:00080000:1.0:1784935549.120384:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784935549.123469:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935549.123606:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273129088 00000100:00100000:1.0:1784935549.123617:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273129088 00000100:00100000:1.0:1784935549.123711:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 54 00000100:00100000:1.0:1784935549.123722:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+29:11130:x1871640273129088:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:1.0:1784935549.123746:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935549.123768:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b16975 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a971 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.123840:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b16975 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a971 expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.123854:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b16975 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a971 expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.123873:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:1.0:1784935549.123876:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784935549.123880:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6d200, rc 0) 00000100:00100000:1.0:1784935549.123969:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+30:11130:x1871640273129088:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 248us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935549.123977:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 54 00000100:00100000:3.0:1784935549.126586:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935549.126862:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273129344 00000100:00100000:2.0:1784935549.126872:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273129344 00000100:00100000:2.0:1784935549.126965:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 9 00000100:00100000:2.0:1784935549.126975:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a0e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+30:11130:x1871640273129344:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:2.0:1784935549.127224:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a0e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+31:11130:x1871640273129344:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 249us (644us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1784935549.127232:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 9 00000100:00100000:2.0:1784935549.229772:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935549.230671:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273129600 00000100:00100000:1.0:1784935549.230695:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273129600 00000100:00100000:1.0:1784935549.230806:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 55 00000100:00100000:1.0:1784935549.230818:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+31:11140:x1871640273129600:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:1.0:1784935549.230845:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935549.230868:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1697c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a978 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935549.231141:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784935549.231252:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1697c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a978 expref: 33 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.231268:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:1.0:1784935549.231271:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784935549.231276:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d600/0x857e02f4e0b1697c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a978 expref: 33 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.231291:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4442a6d600, rc 0) 00000100:00100000:1.0:1784935549.231624:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+32:11140:x1871640273129600:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 807us (1861us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1784935549.231632:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 55 00000100:00100000:3.0:1784935549.235004:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935549.235085:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273129728 00000100:00100000:1.0:1784935549.235095:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273129728 00000100:00100000:1.0:1784935549.235153:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 56 00000100:00100000:1.0:1784935549.235163:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+32:11140:x1871640273129728:12345-192.168.203.28@tcp:34:lfs.0 00010000:00010000:1.0:1784935549.235241:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d800/0x857e02f4e0b1698a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235259:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d800/0x857e02f4e0b1698a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235285:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d800/0x857e02f4e0b1698a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235311:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16991 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235319:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235340:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235415:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16998 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235423:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235430:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784935549.235487:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235500:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d800/0x857e02f4e0b1698a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235506:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d800/0x857e02f4e0b1698a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235512:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d800/0x857e02f4e0b1698a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235528:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6d800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935549.235532:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d800/0x857e02f4e0b1698a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235540:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d800/0x857e02f4e0b1698a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235552:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:1.0:1784935549.235555:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935549.235560:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d800/0x857e02f4e0b1698a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235566:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d800/0x857e02f4e0b1698a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235580:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235586:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16991 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235591:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16991 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235596:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6cc00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935549.235599:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16991 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235605:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16991 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235623:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d457d166800) 00010000:00010000:1.0:1784935549.235625:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935549.235628:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16991 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235634:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6cc00/0x857e02f4e0b16991 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235656:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235663:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16998 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235669:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235673:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6d400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935549.235676:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235682:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16998 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235689:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:1.0:1784935549.235691:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935549.235694:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16998 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.235699:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d400/0x857e02f4e0b16998 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935549.236857:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+32:11140:x1871640273129728:12345-192.168.203.28@tcp:34:lfs.0 Request processed in 1687us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935549.236869:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 56 00000100:00100000:3.0:1784935549.240277:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935549.240466:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273129984 00000100:00100000:2.0:1784935549.240476:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273129984 00000100:00100000:2.0:1784935549.240565:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00100000:2.0:1784935549.240575:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+32:11140:x1871640273129984:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:2.0:1784935549.240794:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+33:11140:x1871640273129984:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 220us (870us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1784935549.240801:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00100000:0.0:1784935549.285650:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935549.286126:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273130240 00000100:00100000:1.0:1784935549.286136:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273130240 00000100:00100000:1.0:1784935549.286222:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 57 00000100:00100000:1.0:1784935549.286232:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+33:11143:x1871640273130240:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:1.0:1784935549.286254:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935549.286272:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b1699f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a97f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286365:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b169a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286380:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b169a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286390:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b169a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286401:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286408:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286415:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286539:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b169b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286549:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b169b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286556:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b169b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935549.286565:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784935549.286638:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b169a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286646:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b169a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286653:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b169a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286659:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935549.286663:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b169a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286670:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b169a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286680:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:1.0:1784935549.286683:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935549.286687:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b169a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286701:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b169a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286714:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286719:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286725:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286730:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935549.286733:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286739:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286745:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d457d166800) 00010000:00010000:1.0:1784935549.286747:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935549.286750:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286755:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286787:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b1699f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a97f expref: 36 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286799:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b169b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a97f expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.286810:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:1.0:1784935549.286812:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935549.286815:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9400, rc 0) 00000100:00100000:1.0:1784935549.286873:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+35:11143:x1871640273130240:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 642us (1231us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1784935549.286879:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 57 00000100:00100000:2.0:1784935549.291147:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935549.291769:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273130368 00000100:00100000:0.0:1784935549.291780:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273130368 00000100:00100000:0.0:1784935549.291836:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 58 00000100:00100000:0.0:1784935549.291846:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+35:11143:x1871640273130368:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:0.0:1784935549.291907:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b169c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.291922:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b169c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.291949:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b169c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.291997:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b169c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.292005:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b169c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.292027:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b169c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.292034:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935549.292038:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b169c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.292445:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b169c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.292459:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:0.0:1784935549.292462:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784935549.292467:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b169c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.292474:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b169c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935549.292554:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+35:11143:x1871640273130368:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 708us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935549.292562:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 58 00000100:00100000:3.0:1784935549.294812:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935549.295211:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273130624 00000100:00100000:1.0:1784935549.295221:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273130624 00000100:00100000:1.0:1784935549.295273:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00100000:1.0:1784935549.295284:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+35:11143:x1871640273130624:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:1.0:1784935549.295795:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+36:11143:x1871640273130624:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 510us (990us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1784935549.295803:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00100000:2.0:1784935549.357320:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292091136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935549.357413:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935549.357456:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292091136 00000100:00100000:1.0:1784935549.357463:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292091136 00000100:00100000:2.0:1784935549.357479:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935549.357485:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292091264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935549.357507:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784935549.357515:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292091136:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935549.357523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1784935549.357547:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935549.357551:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292091264 00000100:00100000:2.0:1784935549.357554:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292091264 00000100:00100000:2.0:1784935549.357573:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784935549.357579:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292091264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784935549.357590:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935549.357606:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292091136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935549.357613:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292091264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935549.357614:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784935549.357617:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784935549.357660:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292091264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935549.357672:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292091136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935549.569473:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935549.569625:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273130880 00000100:00100000:1.0:1784935549.569637:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273130880 00000100:00100000:1.0:1784935549.569706:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 59 00000100:00100000:1.0:1784935549.569716:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+36:11174:x1871640273130880:12345-192.168.203.28@tcp:101:cat.0 00010000:00010000:1.0:1784935549.569757:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935549.569778:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b169c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a986 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.569894:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.569909:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.569921:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935549.569999:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784935549.570142:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b169c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a986 expref: 39 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.570161:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a986 expref: 38 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.570170:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:1.0:1784935549.570173:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935549.570176:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8800, rc 0) 00000100:00100000:1.0:1784935549.570238:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+38:11174:x1871640273130880:12345-192.168.203.28@tcp:101:cat.0 Request processed in 522us (772us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1784935549.570245:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 59 00000100:00100000:3.0:1784935549.575650:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935549.575753:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273131008 00000100:00100000:0.0:1784935549.575764:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273131008 00000100:00100000:0.0:1784935549.575840:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 4 00000100:00100000:0.0:1784935549.575850:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+38:2391:x1871640273131008:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935549.575864:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935549.575890:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b169d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a986 expref: 38 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.575922:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:0.0:1784935549.575977:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935549.576032:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+37:2391:x1871640273131008:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 184us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935549.576040:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 4 00000100:00100000:0.0:1784935549.586372:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935549.586503:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273131264 00000100:00100000:3.0:1784935549.586514:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273131264 00000100:00100000:3.0:1784935549.586571:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 12 00000100:00100000:3.0:1784935549.586581:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+37:11174:x1871640273131264:12345-192.168.203.28@tcp:35:cat.0 00000100:00100000:3.0:1784935549.586833:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+38:11174:x1871640273131264:12345-192.168.203.28@tcp:35:cat.0 Request processed in 253us (470us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1784935549.586841:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 12 00000100:00100000:0.0:1784935549.613405:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935549.613450:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935549.613482:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935549.613550:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273131392 00000100:00100000:1.0:1784935549.613550:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273131520 00000100:00100000:2.0:1784935549.613560:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273131392 00000100:00100000:1.0:1784935549.613560:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273131520 00000100:00100000:1.0:1784935549.613605:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273131648 00000100:00100000:2.0:1784935549.613609:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 375 00000100:00100000:2.0:1784935549.613618:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273131392:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935549.613619:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273131648 00000100:00100000:1.0:1784935549.613642:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 265 00000100:00100000:1.0:1784935549.613648:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273131520:12345-192.168.203.28@tcp:400:kworker.0 00000100:00080000:0.0:1784935549.613708:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784935549.613712:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935549.613736:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 266 00000100:00100000:0.0:1784935549.613746:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273131648:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935549.613793:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273131520:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 144us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935549.613800:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 265 00000100:00100000:2.0:1784935549.618800:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273131392:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 5170us (5335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935549.618816:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 375 00000100:00100000:0.0:1784935549.620439:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273131648:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 6682us (6943us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935549.620460:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 266 00000100:00100000:2.0:1784935549.628498:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935549.629425:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273131776 00000100:00100000:3.0:1784935549.629437:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273131776 00000100:00100000:3.0:1784935549.629732:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 267 00000100:00100000:3.0:1784935549.629744:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273131776:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935549.629836:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273131776:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 94us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935549.629844:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 267 00000100:00080000:0.0:1784935549.633104:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935549.645374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935549.645459:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273132032 00000100:00100000:3.0:1784935549.645478:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273132032 00000100:00100000:3.0:1784935549.645542:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 60 00000100:00100000:3.0:1784935549.645552:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+38:11180:x1871640273132032:12345-192.168.203.28@tcp:101:dd.0 00010000:00010000:3.0:1784935549.645684:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935549.645687:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784935549.645712:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16936 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a95c expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.645745:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:3.0:1784935549.645750:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784935549.645762:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b169de lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a98d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.645863:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.645878:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b169b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a97f expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.645886:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.645915:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b169b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a97f expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.647412:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b169b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a97f expref: 38 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935549.647447:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1871640292091392:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935549.647611:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f1540 going to sleep for 11 seconds 00000100:00100000:3.0:1784935549.649244:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1871640292091392:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935549.649269:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935549.651009:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935549.651231:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273132160 00000100:00100000:3.0:1784935549.651252:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273132160 00010000:00010000:3.0:1784935549.651287:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b169b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a97f expref: 39 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935549.651337:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 55 00000100:00100000:3.0:1784935549.651346:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+39:2392:x1871640273132160:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935549.651360:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935549.651366:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b169b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a97f expref: 39 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.651377:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b169b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a97f expref: 39 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.651397:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b169b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a97f expref: 39 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.651716:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935549.651723:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.651732:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.651740:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.651822:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935549.651886:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+38:2392:x1871640273132160:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 539us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935549.651904:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 55 00010000:00010000:0.0:1784935549.652207:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.652215:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935549.652233:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784935549.652384:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b169de lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a98d expref: 39 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.652414:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a98d expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935549.653074:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:0.0:1784935549.653077:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784935549.653080:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540030e00, rc 0) 00000100:00100000:0.0:1784935549.653248:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+38:11180:x1871640273132032:12345-192.168.203.28@tcp:101:dd.0 Request processed in 7696us (7883us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1784935549.653256:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 60 00000100:00100000:1.0:1784935549.656757:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935549.656873:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273132288 00000100:00100000:0.0:1784935549.656884:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273132288 00000100:00100000:3.0:1784935549.657086:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 61 00000100:00100000:3.0:1784935549.657097:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+38:11180:x1871640273132288:12345-192.168.203.28@tcp:101:dd.0 00010000:00010000:3.0:1784935549.657119:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935549.657140:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b169f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a994 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.657171:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b169fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.657185:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b169fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.657196:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b169fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.658194:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b169f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a994 expref: 40 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.658218:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b169fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a994 expref: 39 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.658226:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935549.658229:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784935549.658232:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529000, rc 0) 00000100:00100000:3.0:1784935549.659163:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+39:11180:x1871640273132288:12345-192.168.203.28@tcp:101:dd.0 Request processed in 2059us (2409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935549.659173:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 61 00000100:00100000:0.0:1784935549.663262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935549.663314:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273132544 00000100:00100000:1.0:1784935549.663336:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273132544 00000100:00100000:1.0:1784935549.663397:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 62 00000100:00100000:1.0:1784935549.663408:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+39:11180:x1871640273132544:12345-192.168.203.28@tcp:36:dd.0 00010000:00010000:1.0:1784935549.663684:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.663701:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.663711:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784935549.663754:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1784935549.663792:0:6525:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d10673df reply state 000000003061c40d transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.663804:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935549.663811:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:1.0:1784935549.663820:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784935549.663824:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784935549.663922:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+42:11180:x1871640273132544:12345-192.168.203.28@tcp:36:dd.0 Request processed in 516us (667us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1784935549.663951:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 62 00000020:00080000:1.0:1784935549.663955:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784935549.870181:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935549.870204:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292091520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784935549.870273:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935549.871406:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292091520 00000100:00100000:0.0:1784935549.871416:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292091520 00000100:00100000:0.0:1784935549.871482:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784935549.871492:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292091520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935549.871529:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935549.871598:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292091520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935549.871605:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784935549.871798:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292091520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935549.987495:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935549.987663:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273132672 00000100:00100000:3.0:1784935549.987673:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273132672 00000100:00100000:3.0:1784935549.987731:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 63 00000100:00100000:3.0:1784935549.987740:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+42:11194:x1871640273132672:12345-192.168.203.28@tcp:101:stat.0 00010000:00010000:3.0:1784935549.987765:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935549.987784:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a99b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.987851:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a0f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.987866:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.987879:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.987890:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.987897:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.987903:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.988014:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.988025:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a98d expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.988051:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.988083:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a98d expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.988095:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a98d expref: 43 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935549.988108:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1871640292091648:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935549.988211:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935549.990557:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935549.990707:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1871640292091648:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935549.990730:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935549.991073:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273132928 00000100:00100000:0.0:1784935549.991081:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273132928 00000100:00100000:0.0:1784935549.991141:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 13 00000100:00100000:0.0:1784935549.991151:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+44:6159:x1871640273132928:12345-192.168.203.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784935549.991488:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+45:6159:x1871640273132928:12345-192.168.203.28@tcp:35:ldlm_bl.0 Request processed in 337us (937us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1784935549.991503:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 13 00000100:00100000:1.0:1784935549.994050:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935549.994204:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273133056 00000100:00100000:2.0:1784935549.994213:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273133056 00010000:00010000:2.0:1784935549.994248:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a98d expref: 45 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935549.994298:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 56 00000100:00100000:2.0:1784935549.994332:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+45:2392:x1871640273133056:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935549.994349:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935549.994357:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a98d expref: 45 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.994371:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a98d expref: 45 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.994394:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b169e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a98d expref: 45 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.994411:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:2.0:1784935549.994417:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.994428:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.994435:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935549.994694:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784935549.994835:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.994845:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935549.994897:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784935549.994902:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935549.994982:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.994995:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995019:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995026:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a0f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995032:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995037:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935549.995041:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995048:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a0f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995057:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:3.0:1784935549.995059:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935549.995062:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995068:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995078:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995084:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995090:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995101:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935549.995104:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995110:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995117:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d457d166800) 00010000:00010000:3.0:1784935549.995120:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935549.995122:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995127:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995158:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a99b expref: 45 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995173:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a99b expref: 44 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935549.995179:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935549.995181:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784935549.995183:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529e00, rc 0) 00000100:00100000:2.0:1784935549.996379:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+44:2392:x1871640273133056:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 2051us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935549.996390:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 56 00000100:00100000:3.0:1784935549.997818:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+43:11194:x1871640273132672:12345-192.168.203.28@tcp:101:stat.0 Request processed in 10070us (10325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935549.997830:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 63 00000100:00100000:2.0:1784935550.059515:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.059606:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273133312 00000100:00100000:3.0:1784935550.059629:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273133312 00000100:00100000:3.0:1784935550.059703:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 64 00000100:00100000:3.0:1784935550.059713:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+43:11200:x1871640273133312:12345-192.168.203.28@tcp:36:truncate.0 00010000:00010000:3.0:1784935550.059767:0:12375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935550.059791:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a99b expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.059810:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.059815:0:12375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784935550.060027:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.060040:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.060048:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784935550.060084:0:12375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1784935550.060103:0:12375:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004190db30 reply state 0000000032c8f406 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.060114:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.060121:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.060124:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784935550.060126:0:12375:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784935550.060224:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+45:11200:x1871640273133312:12345-192.168.203.28@tcp:36:truncate.0 Request processed in 512us (779us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1784935550.060231:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 64 00000020:00080000:3.0:1784935550.060243:0:12375:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1784935550.060585:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784935550.064481:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935550.179483:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.179582:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273133440 00000100:00100000:3.0:1784935550.179591:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273133440 00000100:00100000:3.0:1784935550.179706:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 65 00000100:00100000:3.0:1784935550.179716:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+45:11215:x1871640273133440:12345-192.168.203.28@tcp:101:stat.0 00010000:00010000:3.0:1784935550.179740:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935550.179759:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.179836:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a32 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.179851:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.179863:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.179874:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.179881:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.179887:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.179992:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180002:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180026:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935550.180066:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1784935550.180071:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935550.180090:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180101:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180108:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180114:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a32 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180120:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180126:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935550.180130:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180138:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180149:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:3.0:1784935550.180152:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935550.180157:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180172:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16a32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180185:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180191:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180196:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180201:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935550.180205:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180210:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180218:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d457d166800) 00010000:00010000:3.0:1784935550.180221:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935550.180224:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180229:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180253:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9a2 expref: 47 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180266:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9a2 expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.180281:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.180283:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784935550.180513:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d454166ae00, rc 0) 00000100:00100000:3.0:1784935550.180585:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+46:11215:x1871640273133440:12345-192.168.203.28@tcp:101:stat.0 Request processed in 869us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935550.180592:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 65 00000100:00100000:1.0:1784935550.247168:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.247242:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273133696 00000100:00100000:3.0:1784935550.247252:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273133696 00000100:00100000:2.0:1784935550.247376:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 66 00000100:00100000:2.0:1784935550.247390:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+46:11225:x1871640273133696:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935550.247430:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935550.247450:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b16a47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9a9 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935550.247546:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1784935550.247644:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b16a47 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9a9 expref: 48 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.247657:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:2.0:1784935550.247661:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784935550.247665:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b16a47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9a9 expref: 48 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.247678:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200000, rc 0) 00000100:00100000:2.0:1784935550.248726:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+47:11225:x1871640273133696:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 1335us (1561us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1784935550.248736:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 66 00000100:00100000:2.0:1784935550.254284:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935550.255701:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273133952 00000100:00100000:0.0:1784935550.255715:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273133952 00000100:00100000:0.0:1784935550.255789:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00100000:0.0:1784935550.255799:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+47:11225:x1871640273133952:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:0.0:1784935550.260649:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+48:11225:x1871640273133952:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 4842us (6374us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1784935550.260663:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00100000:1.0:1784935550.341190:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935550.341281:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273134208 00000100:00100000:0.0:1784935550.341293:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273134208 00000100:00100000:0.0:1784935550.341357:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 67 00000100:00100000:0.0:1784935550.341368:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+48:11231:x1871640273134208:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:0.0:1784935550.341392:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935550.341413:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16a55 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9b0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.341514:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.341529:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9a2 expref: 49 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.341537:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.341569:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9a2 expref: 49 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.341588:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9a2 expref: 49 pid: 6527 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935550.341600:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d394700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292091776:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935550.342049:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547429000 going to sleep for 11 seconds 00000100:00100000:0.0:1784935550.349978:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d394700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292091776:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935550.350007:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935550.350527:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.350607:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273134336 00000100:00100000:3.0:1784935550.350615:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273134336 00010000:00010000:3.0:1784935550.350661:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9a2 expref: 50 pid: 6527 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935550.350699:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 57 00000100:00100000:3.0:1784935550.350708:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45729c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+50:2392:x1871640273134336:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935550.350723:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935550.350730:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9a2 expref: 50 pid: 6527 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.350743:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9a2 expref: 50 pid: 6527 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.350782:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9a2 expref: 50 pid: 6527 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.350798:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.350815:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.350825:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.350831:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.350858:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935550.350907:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45729c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+49:2392:x1871640273134336:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 199us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935550.350913:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 57 00010000:00010000:0.0:1784935550.351470:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.351479:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935550.351495:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1784935550.351610:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16a55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b0 expref: 50 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.351625:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b0 expref: 49 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.351633:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:0.0:1784935550.351635:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784935550.351638:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699400, rc 0) 00000100:00100000:0.0:1784935550.351696:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+49:11231:x1871640273134208:12345-192.168.203.28@tcp:101:bash.0 Request processed in 10330us (10516us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1784935550.351712:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 67 00000100:00100000:1.0:1784935550.357326:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.357761:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273134592 00000100:00100000:3.0:1784935550.357783:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273134592 00000100:00100000:3.0:1784935550.357846:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 68 00000100:00100000:3.0:1784935550.357857:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+49:11231:x1871640273134592:12345-192.168.203.28@tcp:36:bash.0 00010000:00010000:3.0:1784935550.358282:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.358852:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.358862:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784935550.358912:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1784935550.358960:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001bf27648 reply state 000000000c74bb8d transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.358972:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.359384:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.359387:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784935550.359391:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784935550.359574:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+52:11231:x1871640273134592:12345-192.168.203.28@tcp:36:bash.0 Request processed in 1716us (2264us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1784935550.359583:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 68 00000020:00080000:3.0:1784935550.359589:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784935550.376753:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.376862:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273134720 00000100:00100000:3.0:1784935550.376873:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273134720 00000100:00100000:3.0:1784935550.376973:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 69 00000100:00100000:3.0:1784935550.376983:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+52:11231:x1871640273134720:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:3.0:1784935550.377006:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935550.377023:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9b7 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.377116:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ac00/0x857e02f4e0b16a78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.377130:0:12375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b0 expref: 53 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.377139:0:12375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ac00/0x857e02f4e0b16a78 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.377169:0:12375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b0 expref: 53 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.377182:0:12375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b0 expref: 53 pid: 6525 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935550.377203:0:12375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292091904:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935550.377287:0:12375:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784935550.385131:0:12375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292091904:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935550.385161:0:12375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ac00/0x857e02f4e0b16a78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935550.386528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935550.386696:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273134848 00000100:00100000:0.0:1784935550.386706:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273134848 00010000:00010000:0.0:1784935550.386744:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b0 expref: 54 pid: 6525 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935550.386782:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 58 00000100:00100000:0.0:1784935550.386792:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+54:2391:x1871640273134848:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935550.386806:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935550.386813:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b0 expref: 54 pid: 6525 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.386824:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b0 expref: 54 pid: 6525 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.386847:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a5c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b0 expref: 54 pid: 6525 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.386862:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:0.0:1784935550.386868:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ac00/0x857e02f4e0b16a78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.386877:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ac00/0x857e02f4e0b16a78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.386885:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ac00/0x857e02f4e0b16a78 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.386942:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935550.386997:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+53:2391:x1871640273134848:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 205us (475us total) trans 0 rc 0/0 00010000:00010000:3.0:1784935550.387002:0:12375:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ac00/0x857e02f4e0b16a78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935550.387006:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 58 00010000:00010000:3.0:1784935550.387017:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ac00/0x857e02f4e0b16a78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935550.387070:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784935550.387074:0:12375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935550.387093:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ac00/0x857e02f4e0b16a78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.387121:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b7 expref: 53 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.387136:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ac00/0x857e02f4e0b16a78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b7 expref: 52 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.387144:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.387147:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784935550.387149:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d454166ac00, rc 0) 00000100:00100000:3.0:1784935550.387175:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+52:11231:x1871640273134720:12345-192.168.203.28@tcp:101:bash.0 Request processed in 10195us (10441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935550.387188:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 69 00000100:00100000:2.0:1784935550.394328:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935550.394414:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273135104 00000100:00100000:0.0:1784935550.394424:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273135104 00000100:00100000:0.0:1784935550.394481:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00100000:0.0:1784935550.394491:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a0d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+52:11231:x1871640273135104:12345-192.168.203.28@tcp:35:bash.0 00000100:00100000:0.0:1784935550.394707:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a0d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+53:11231:x1871640273135104:12345-192.168.203.28@tcp:35:bash.0 Request processed in 216us (395us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1784935550.394714:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00100000:2.0:1784935550.519282:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935550.519403:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273135360 00000100:00100000:0.0:1784935550.519415:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273135360 00000100:00100000:0.0:1784935550.519481:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 70 00000100:00100000:0.0:1784935550.519492:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+53:11241:x1871640273135360:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935550.519529:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935550.519550:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9be expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935550.519652:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784935550.519740:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9be expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.519757:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:0.0:1784935550.519760:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784935550.519778:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16a7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9be expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.519794:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699400, rc 0) 00000100:00100000:0.0:1784935550.519856:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+54:11241:x1871640273135360:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 365us (583us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1784935550.519863:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 70 00000100:00100000:2.0:1784935550.525579:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.525705:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273135488 00000100:00100000:3.0:1784935550.525714:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273135488 00000100:00100000:3.0:1784935550.525769:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 71 00000100:00100000:3.0:1784935550.525778:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+54:11241:x1871640273135488:12345-192.168.203.28@tcp:34:lfs.0 00010000:00010000:3.0:1784935550.525848:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a8d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.525864:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.525875:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.525887:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.525894:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.525900:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526007:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526016:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526022:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784935550.526085:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526200:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526208:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a8d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526214:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526220:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166aa00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935550.526224:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526231:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526242:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:3.0:1784935550.526245:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935550.526249:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526255:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16a8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526267:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526273:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526284:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526290:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935550.526293:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526300:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526308:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d457d166800) 00010000:00010000:3.0:1784935550.526310:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935550.526313:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526328:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16a94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526339:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526345:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526350:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526355:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935550.526358:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526480:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526489:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.526491:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935550.526494:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.526500:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16a9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935550.526605:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+54:11241:x1871640273135488:12345-192.168.203.28@tcp:34:lfs.0 Request processed in 826us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935550.526613:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 71 00000100:00100000:2.0:1784935550.534803:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935550.534904:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273135744 00000100:00100000:0.0:1784935550.534914:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273135744 00000100:00100000:0.0:1784935550.535001:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00100000:0.0:1784935550.535012:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+54:11241:x1871640273135744:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:0.0:1784935550.535233:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+55:11241:x1871640273135744:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 222us (439us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1784935550.535240:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00100000:2.0:1784935550.600356:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.600550:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273136000 00000100:00100000:3.0:1784935550.600563:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273136000 00000100:00100000:3.0:1784935550.600623:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 72 00000100:00100000:3.0:1784935550.600633:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+55:11244:x1871640273136000:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935550.600657:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935550.600676:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16aa2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9c5 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.600745:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16aa9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.600759:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.600770:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.600797:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16ab0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.600805:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.600811:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.600908:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16ab7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.600916:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.600923:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935550.600958:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784935550.601037:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601044:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16aa9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601050:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601056:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935550.601059:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601076:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601087:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:3.0:1784935550.601090:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935550.601103:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16aa9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601110:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b16aa9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601124:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601130:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601136:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601140:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935550.601143:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601149:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601156:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d457d166800) 00010000:00010000:3.0:1784935550.601159:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935550.601161:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16ab0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601176:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b16ab0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601209:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529400/0x857e02f4e0b16aa2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9c5 expref: 58 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601221:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9c5 expref: 57 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.601227:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.601230:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784935550.601232:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d454166aa00, rc 0) 00000100:00100000:3.0:1784935550.601300:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+57:11244:x1871640273136000:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 668us (953us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1784935550.601307:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 72 00000100:00100000:2.0:1784935550.605759:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935550.605805:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935550.605898:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273136128 00000100:00100000:1.0:1784935550.605907:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273136128 00000100:00100000:1.0:1784935550.606007:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 5 00000100:00100000:1.0:1784935550.606017:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+57:2391:x1871640273136128:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935550.606031:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935550.606053:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166aa00/0x857e02f4e0b16ab7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9c5 expref: 57 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935550.606072:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:1.0:1784935550.606076:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935550.606130:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+56:2391:x1871640273136128:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 115us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935550.606144:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 5 00000100:00100000:3.0:1784935550.606726:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273136256 00000100:00100000:3.0:1784935550.606733:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273136256 00000100:00100000:3.0:1784935550.606806:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 73 00000100:00100000:3.0:1784935550.606815:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+56:11244:x1871640273136256:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:3.0:1784935550.606869:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16ac5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.606883:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.606893:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.606951:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.606958:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.606964:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.606970:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935550.606974:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.606981:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.606991:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.606994:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784935550.606997:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16ac5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.607003:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16ac5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935550.607053:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+56:11244:x1871640273136256:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 239us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935550.607059:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 73 00000100:00100000:2.0:1784935550.611673:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.611778:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273136512 00000100:00100000:3.0:1784935550.611789:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273136512 00000100:00100000:3.0:1784935550.611885:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:3.0:1784935550.611912:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+56:11244:x1871640273136512:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:3.0:1784935550.612355:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+57:11244:x1871640273136512:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 443us (688us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1784935550.612363:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:2.0:1784935550.821233:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.821545:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273136768 00000100:00100000:3.0:1784935550.821556:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273136768 00000100:00100000:3.0:1784935550.821654:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 74 00000100:00100000:3.0:1784935550.821665:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+57:11262:x1871640273136768:12345-192.168.203.28@tcp:101:cat.0 00010000:00010000:3.0:1784935550.821689:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935550.821708:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16acc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9cc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.821817:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16ad3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.821833:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.821846:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935550.821856:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784935550.821992:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16acc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9cc expref: 60 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.822011:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9cc expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.822038:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.822041:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784935550.822044:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021a00, rc 0) 00000100:00100000:3.0:1784935550.822108:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+59:11262:x1871640273136768:12345-192.168.203.28@tcp:101:cat.0 Request processed in 444us (885us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1784935550.822115:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 74 00000100:00100000:2.0:1784935550.866402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935550.868758:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273136896 00000100:00100000:0.0:1784935550.868774:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273136896 00000100:00100000:0.0:1784935550.868911:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 75 00000100:00100000:0.0:1784935550.868922:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+59:11263:x1871640273136896:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935550.868966:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935550.868986:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16ae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.869049:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699a00/0x857e02f4e0b16ae8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.869062:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699a00/0x857e02f4e0b16ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.869092:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699a00/0x857e02f4e0b16ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935550.869134:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784935550.869137:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935550.869154:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699a00/0x857e02f4e0b16ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.869177:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16ae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9d3 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.869194:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699a00/0x857e02f4e0b16ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9d3 expref: 60 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935550.869203:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935550.869206:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784935550.869209:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699a00, rc 0) 00000100:00100000:0.0:1784935550.869277:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11263:x1871640273136896:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 357us (2885us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935550.869292:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 75 00000100:00100000:1.0:1784935550.874627:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935550.879532:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273137280 00000100:00100000:2.0:1784935550.879547:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273137280 00000100:00100000:2.0:1784935550.879614:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:2.0:1784935550.879624:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11263:x1871640273137280:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:2.0:1784935550.879924:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11263:x1871640273137280:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 299us (5305us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1784935550.879955:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:2.0:1784935550.884982:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.885378:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273137408 00000100:00100000:3.0:1784935550.885388:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273137408 00000100:00100000:3.0:1784935550.885450:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 6 00000100:00100000:3.0:1784935550.885460:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11263:x1871640273137408:12345-192.168.203.28@tcp:103:lfs.0 00010000:00010000:3.0:1784935550.885478:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784935550.885503:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ac00/0x857e02f4e0b16a78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9b7 expref: 61 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.885527:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16ad3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9cc expref: 60 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.885542:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6d200/0x857e02f4e0b16975 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a971 expref: 59 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.885552:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.885557:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935550.885604:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+58:11263:x1871640273137408:12345-192.168.203.28@tcp:103:lfs.0 Request processed in 144us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935550.885611:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 6 00000100:00100000:2.0:1784935550.890904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.890986:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273137536 00000100:00100000:3.0:1784935550.890996:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273137536 00000100:00100000:3.0:1784935550.891056:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 76 00000100:00100000:3.0:1784935550.891066:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4442956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+58:11263:x1871640273137536:12345-192.168.203.28@tcp:58:lfs.0 00010000:00010000:3.0:1784935550.891181:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16aef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.891201:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16aef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.891213:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16aef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784935550.891587:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784935550.891780:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1784935550.891875:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1784935550.891997:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4442956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+58:11263:x1871640273137536:12345-192.168.203.28@tcp:58:lfs.0 Request processed in 930us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935550.892006:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 76 00000100:00100000:1.0:1784935550.921266:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.921401:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273137664 00000100:00100000:3.0:1784935550.921413:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273137664 00000100:00100000:3.0:1784935550.921488:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 77 00000100:00100000:3.0:1784935550.921498:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+58:11265:x1871640273137664:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935550.921517:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935550.921535:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16af6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9da expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.921595:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16afd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.921624:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16afd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.921755:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16afd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.921771:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.921778:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.921784:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.921855:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.921865:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.921872:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935550.921920:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784935550.921924:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935550.922102:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922116:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922136:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16afd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922142:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16afd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922149:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16afd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922154:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935550.922158:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16afd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922165:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16afd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922177:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:3.0:1784935550.922179:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935550.922184:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16afd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922189:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16afd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922203:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922209:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922214:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922224:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935550.922227:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922233:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922241:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d457d166800) 00010000:00010000:3.0:1784935550.922244:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935550.922246:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922252:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922280:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16af6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9da expref: 60 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922606:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9da expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.922615:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.922617:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784935550.922619:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020a00, rc 0) 00000100:00100000:3.0:1784935550.922985:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+59:11265:x1871640273137664:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 1487us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935550.922994:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 77 00000040:00080000:3.0:1784935550.957148:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784935550.957167:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784935550.957208:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784935550.957219:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784935550.957367:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292092032:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784935550.957489:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f1900 going to sleep for 11 seconds 00000040:00080000:2.0:1784935550.962004:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784935550.969181:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935550.969229:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273137792 00000100:00100000:0.0:1784935550.969239:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273137792 00000100:00100000:0.0:1784935550.969329:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 78 00000100:00100000:0.0:1784935550.969341:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11269:x1871640273137792:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784935550.969374:0:6525:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784935550.969498:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11269:x1871640273137792:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 160us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935550.969522:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 78 00000100:00100000:3.0:1784935550.969740:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292092032:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784935550.973153:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935550.982205:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273137920 00000100:00100000:2.0:1784935550.982224:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273137920 00000100:00100000:2.0:1784935550.982330:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 79 00000100:00100000:2.0:1784935550.982341:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+59:11269:x1871640273137920:12345-192.168.203.28@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784935550.982599:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b12 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982617:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982628:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982686:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982712:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982720:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982749:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16b20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982760:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982766:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935550.982807:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784935550.982812:0:12375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935550.982824:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982833:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982839:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b12 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982845:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982851:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935550.982855:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982883:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b12 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982897:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:2.0:1784935550.982899:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935550.982904:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982909:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982921:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982968:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b19 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982974:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982980:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935550.982983:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982989:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b19 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.982995:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8d457d145a00) 00010000:00010000:2.0:1784935550.982998:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935550.983001:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b19 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.983016:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.983033:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.983039:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16b20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.983045:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16b20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.983050:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935550.983053:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16b20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.983058:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16b20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.983066:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:2.0:1784935550.983068:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935550.983071:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16b20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935550.983078:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200200/0x857e02f4e0b16b20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935550.983177:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+59:11269:x1871640273137920:12345-192.168.203.28@tcp:34:lhsmtool_posix.0 Request processed in 835us (10031us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935550.983185:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 79 00000100:00100000:2.0:1784935550.996531:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935550.996736:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273138176 00000100:00100000:3.0:1784935550.996747:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273138176 00000100:00100000:3.0:1784935550.996811:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 80 00000100:00100000:3.0:1784935550.996822:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+59:11269:x1871640273138176:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784935550.996846:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935550.996877:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9e1 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997014:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997028:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997039:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935550.997052:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784935550.997132:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997140:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997166:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997172:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935550.997177:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997185:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997196:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935550.997200:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784935550.997204:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b2e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997212:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997257:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b27 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9e1 expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997269:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:3.0:1784935550.997272:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784935550.997276:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9e1 expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935550.997285:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020800, rc 0) 00000100:00100000:3.0:1784935550.997352:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11269:x1871640273138176:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 532us (830us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1784935550.997583:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 80 00000100:00100000:1.0:1784935551.011580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935551.011745:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273138304 00000100:00100000:0.0:1784935551.011755:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273138304 00000100:00100000:0.0:1784935551.011811:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 81 00000100:00100000:0.0:1784935551.011820:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11269:x1871640273138304:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784935551.011856:0:6525:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784935551.012002:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11269:x1871640273138304:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 183us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935551.012009:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 81 00000100:00100000:0.0:1784935551.017499:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.017600:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273138560 00000100:00100000:2.0:1784935551.017609:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273138560 00000100:00100000:2.0:1784935551.017671:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 82 00000100:00100000:2.0:1784935551.017681:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11269:x1871640273138560:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784935551.017702:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935551.017705:0:12375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784935551.017731:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699a00/0x857e02f4e0b16ae8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9d3 expref: 60 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.017752:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:2.0:1784935551.017756:0:12375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935551.017769:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b3c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9e8 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784935551.018218:0:12375:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1784935551.018370:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.018383:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.018392:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.018444:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16b3c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9e8 expref: 62 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.018460:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9e8 expref: 61 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.018476:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d145a00) 00010000:00010000:2.0:1784935551.018478:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935551.018481:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201e00, rc 0) 00000100:00100000:2.0:1784935551.018550:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11269:x1871640273138560:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 870us (1059us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1784935551.018558:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 82 00000100:00100000:2.0:1784935551.035275:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935551.035383:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273138816 00000100:00100000:1.0:1784935551.035393:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273138816 00000100:00100000:1.0:1784935551.035566:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 83 00000100:00100000:1.0:1784935551.035579:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11269:x1871640273138816:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784935551.035637:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935551.035665:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16b43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9e8 expref: 61 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.035684:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d145a00) 00010000:00010000:1.0:1784935551.035695:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935551.035718:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036403:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036417:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036474:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b16b58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xca887174 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036483:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b16b58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xca887174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036501:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b16b58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xca887174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036546:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036553:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b51 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036560:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036566:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935551.036571:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036578:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b51 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036588:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:1.0:1784935551.036591:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935551.036595:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b51 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036601:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b51 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036611:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b16b58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xca887174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036617:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b16b58 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xca887174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036630:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b16b58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xca887174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036634:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935551.036637:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b16b58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xca887174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036644:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b16b58 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xca887174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036652:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xca887174 (ffff8d457d166c00) 00010000:00010000:1.0:1784935551.036655:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935551.036657:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b16b58 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xca887174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.036662:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b16b58 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xca887174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935551.036746:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11269:x1871640273138816:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 1168us (1478us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784935551.039278:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 83 00000100:00100000:0.0:1784935551.044635:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935551.044742:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273138944 00000100:00100000:1.0:1784935551.044751:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273138944 00000100:00100000:1.0:1784935551.044814:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 84 00000100:00100000:1.0:1784935551.044824:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11269:x1871640273138944:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935551.044844:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935551.044866:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16b5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9ef expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.044921:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16b66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.045191:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.045204:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.045385:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16b5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9ef expref: 62 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.045403:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16b66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9ef expref: 61 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.045411:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:0.0:1784935551.045414:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784935551.045418:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9a00, rc 0) 00000100:00100000:0.0:1784935551.045626:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11269:x1871640273138944:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 802us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935551.045634:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 84 00000100:00100000:2.0:1784935551.048306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935551.048393:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273139200 00000100:00100000:3.0:1784935551.048404:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273139200 00000100:00100000:3.0:1784935551.048463:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 85 00000100:00100000:3.0:1784935551.048474:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11269:x1871640273139200:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784935551.048552:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.048567:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.048577:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784935551.048729:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1784935551.048739:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370298810997ns, next at 371298808617ns, rc = 0 00000004:00010000:3.0:1784935551.048786:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021a980c7 reply state 000000007d5782ae transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.048798:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.048804:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:3.0:1784935551.048807:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784935551.048810:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784935551.048912:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+63:11269:x1871640273139200:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 440us (613us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1784935551.048919:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 85 00000100:00100000:2.0:1784935551.055114:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935551.058664:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273139328 00000100:00100000:1.0:1784935551.058680:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273139328 00000100:00100000:1.0:1784935551.058765:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 86 00000100:00100000:1.0:1784935551.058775:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+63:11269:x1871640273139328:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935551.058799:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935551.058819:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9f6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.058877:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9f6 expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.058893:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9f6 expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.058912:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:1.0:1784935551.058916:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784935551.058919:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9800, rc 0) 00000100:00100000:1.0:1784935551.059152:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+64:11269:x1871640273139328:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 378us (4047us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935551.059175:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 86 00000100:00100000:1.0:1784935551.062473:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.062683:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273139456 00000100:00100000:2.0:1784935551.062693:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273139456 00000100:00100000:2.0:1784935551.062744:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 32 00000100:00100000:2.0:1784935551.062752:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1871640273139456:12345-192.168.203.28@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1784935551.062784:0:8439:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:2.0:1784935551.062811:0:8439:0:(genops.c:1406:class_connect()) connect: client 380c344d-145d-4a03-bcd4-797f2a6954a7, cookie 0x857e02f4e0b16b7b 00002000:00100000:2.0:1784935551.062823:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 380c344d-145d-4a03-bcd4-797f2a6954a7/ffff8d4549f2d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784935551.062840:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784935551.062917:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784935551.062989:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8d4549f2d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784935551.063064:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2390:x1871640273139456:12345-192.168.203.28@tcp:8:lhsmtool_posix.0 Request processed in 311us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935551.063071:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 32 00000100:00100000:0.0:1784935551.069615:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.072442:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273139584 00000100:00100000:2.0:1784935551.072464:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273139584 00000100:00100000:2.0:1784935551.072573:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 33 00000100:00100000:2.0:1784935551.072584:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:0:x1871640273139584:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1784935551.073102:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1784935551.083490:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1784935551.083523:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000100:00100000:2.0:1784935551.085497:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:0:x1871640273139584:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 Request processed in 12887us (15865us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784935551.085511:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 33 00000100:00100000:3.0:1784935551.091748:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.091856:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273139840 00000100:00100000:2.0:1784935551.091866:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273139840 00000100:00100000:2.0:1784935551.091923:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 19 00000100:00100000:2.0:1784935551.091963:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+64:11269:x1871640273139840:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784935551.092169:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+65:11269:x1871640273139840:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 208us (428us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1784935551.092177:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 19 00010000:00010000:2.0:1784935551.094553:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935551.111731:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.111869:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273140096 00000100:00100000:2.0:1784935551.111878:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273140096 00000100:00100000:2.0:1784935551.111952:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 87 00000100:00100000:2.0:1784935551.111962:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+65:11269:x1871640273140096:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784935551.112068:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+65:11269:x1871640273140096:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 108us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935551.112076:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 87 00000100:00100000:0.0:1784935551.118667:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935551.118762:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273140224 00000100:00100000:3.0:1784935551.118772:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273140224 00000100:00100000:3.0:1784935551.118831:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 88 00000100:00100000:3.0:1784935551.118841:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+65:11269:x1871640273140224:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784935551.118861:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935551.118882:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313a9fd expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.118985:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16b89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.118998:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.119009:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935551.119050:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935551.119069:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.119093:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16b82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9fd expref: 67 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.119109:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16b89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9fd expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.119117:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:3.0:1784935551.119132:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784935551.119136:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021000, rc 0) 00000100:00100000:3.0:1784935551.119187:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+66:11269:x1871640273140224:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 347us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935551.119193:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 88 00000100:00100000:3.0:1784935551.126726:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.126865:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273140352 00000100:00100000:2.0:1784935551.126875:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273140352 00000100:00100000:2.0:1784935551.126955:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 34 00000100:00100000:2.0:1784935551.126965:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273140352:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784935551.126993:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935551.127027:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b16b90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa04 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935551.127051:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63f47f, blocks: 0x0 00010000:00010000:2.0:1784935551.127072:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1784935551.127077:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935551.127088:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b16b90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa04 expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.127111:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b16b90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa04 expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.127123:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201000, rc 0) 00000100:00100000:2.0:1784935551.127187:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273140352:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 223us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935551.127194:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 34 00000100:00100000:0.0:1784935551.137824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935551.139072:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273140608 00000100:00100000:3.0:1784935551.139084:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273140608 00000100:00100000:3.0:1784935551.139152:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 89 00000100:00100000:3.0:1784935551.139162:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+66:11269:x1871640273140608:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784935551.139265:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+66:11269:x1871640273140608:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 104us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935551.139273:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 89 00000100:00100000:3.0:1784935551.142409:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.142765:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273140736 00000100:00100000:2.0:1784935551.142776:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273140736 00000100:00100000:2.0:1784935551.142869:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 35 00000100:00100000:2.0:1784935551.142879:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:11269:x1871640273140736:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784935551.142899:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935551.142918:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa0b expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.142994:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b16b90 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa04 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.143021:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935551.143025:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935551.143031:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.143065:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b16b90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa04 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.143079:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b16b90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa04 expref: 7 pid: 8439 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935551.143093:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1871640292092160:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935551.143184:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2000 going to sleep for 11 seconds 00000100:00100000:3.0:1784935551.145835:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935551.146216:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273140864 00000100:00100000:0.0:1784935551.146225:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273140864 00010000:00010000:0.0:1784935551.146268:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b16b90 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa04 expref: 8 pid: 8439 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935551.146331:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 59 00000100:00100000:0.0:1784935551.146342:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273140864:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935551.146357:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935551.146377:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b16b90 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa04 expref: 8 pid: 8439 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.146391:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b16b90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa04 expref: 8 pid: 8439 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.146418:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935551.146423:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935551.146431:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.146440:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.146483:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935551.146521:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d396300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6511:1871640292092288:192.168.203.28@tcp:105: 00000100:00100000:0.0:1784935551.146599:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a780 going to sleep for 11 seconds 00010000:00010000:2.0:1784935551.147601:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b16b90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa04 expref: 8 pid: 8439 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935551.147620:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1871640292092160:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935551.147647:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.147659:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201200, rc 0) 00000100:00100000:2.0:1784935551.147703:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:11269:x1871640273140736:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 4825us (5304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935551.147724:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 35 00000100:00100000:0.0:1784935551.150775:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d396300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6511:1871640292092288:192.168.203.28@tcp:105: 00010000:00010000:0.0:1784935551.150810:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935551.150872:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273140864:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 4531us (5048us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935551.150891:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 59 00000100:00100000:1.0:1784935551.157773:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935551.158337:0:8446:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273140992 00000100:00100000:3.0:1784935551.158347:0:8446:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273140992 00002000:00100000:3.0:1784935551.158391:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8d4574006680 x1871640273140992/t0(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:47/0 lens 504/0 e 0 to 0 dl 1784935562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784935551.158401:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4574006680 with x1871640273140992 ext(0->8) 00002000:00010000:3.0:1784935551.158407:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4574006680 00000100:00100000:3.0:1784935551.158447:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 0 00000100:00100000:3.0:1784935551.158457:0:8446:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273140992:12345-192.168.203.28@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1784935551.159474:0:8446:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2392:x1871640273140992:12345-192.168.203.28@tcp:4:lhsmtool_posix.0 Request processed in 1011us (1707us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1784935551.159497:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 0 00002000:00100000:3.0:1784935551.159507:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8d4574006680 x1871640273140992/t4294967303(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:47/0 lens 504/448 e 0 to 0 dl 1784935562 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784935551.159516:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4574006680 with x1871640273140992 ext(0->8) 00002000:00010000:3.0:1784935551.159520:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4574006680 00000100:00100000:3.0:1784935551.173300:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935551.173373:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273141120 00000100:00100000:1.0:1784935551.173384:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273141120 00000100:00100000:1.0:1784935551.173443:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 90 00000100:00100000:1.0:1784935551.173454:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+66:11269:x1871640273141120:12345-192.168.203.28@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784935551.175497:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1784935551.175516:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1784935551.175586:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1784935551.175604:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d45430f9d80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1784935551.175610:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d444281e800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d455199f600 00000020:00080000:2.0:1784935551.175613:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d444281ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d444305d200 00000020:00080000:2.0:1784935551.175697:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1784935551.175798:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+20:11269:x1871640273141120:12345-192.168.203.28@tcp:44:lhsmtool_posix.0 Request processed in 2341us (2508us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935551.175808:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 90 00000020:00080000:2.0:1784935551.175842:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1784935551.175846:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292092544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784935551.175910:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935551.175982:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292092416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784935551.176005:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935551.176039:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292092544 00000100:00100000:1.0:1784935551.176045:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292092544 00000100:00100000:1.0:1784935551.176085:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292092416 00000100:00100000:1.0:1784935551.176088:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292092416 00010000:00010000:3.0:1784935551.176110:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935551.176110:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784935551.176117:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640292092544:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784935551.176121:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176128:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176134:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698e00 already unused, calling callback (ffffffffc18c54f0) 00002000:00080000:1.0:1784935551.176138:0:8987:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:3.0:1784935551.176139:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176145:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176160:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d45705a8c00) 00010000:00010000:3.0:1784935551.176162:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:1.0:1784935551.176164:0:8987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a63f47d, atime: 0x6a63f47d, ctime: 0x6a63f47d, blocks: 0x8 00010000:00010000:3.0:1784935551.176167:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176170:0:8987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b371d7f/0x857e02f4e0b16b9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176173:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b168b1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176195:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1784935551.176200:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935551.176204:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176206:0:8987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b371d7f/0x857e02f4e0b16b9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176211:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176217:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176221:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935551.176221:0:8987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b371d7f/0x857e02f4e0b16b9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176224:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176230:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176230:0:8987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b371d7f/0x857e02f4e0b16b9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176237:0:8987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b371d7f/0x857e02f4e0b16b9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176238:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:3.0:1784935551.176240:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935551.176243:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176248:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b168b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176253:0:8987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935551.176259:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176264:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176269:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176279:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6ce00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935551.176296:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176302:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176319:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d457d166800) 00010000:00010000:3.0:1784935551.176322:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935551.176325:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176330:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6ce00/0x857e02f4e0b168f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176347:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176352:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176358:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176363:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935551.176366:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176371:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935551.176382:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3652:x1871640292092544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 265us (471us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1784935551.176389:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1784935551.176390:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935551.176392:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935551.176395:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176401:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b16a01 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935551.176409:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:3.0:1784935551.176411:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935551.176415:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292092416:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1784935551.176418:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176424:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176428:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935551.176431:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176436:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176443:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935551.176445:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935551.176447:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176452:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528200/0x857e02f4e0b16a24 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176472:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176478:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784935551.176481:0:8987:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:3.0:1784935551.176483:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784935551.176484:0:8987:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784935551 00002000:00010000:1.0:1784935551.176486:0:8987:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:3.0:1784935551.176489:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166ae00 already unused, calling callback (ffffffffc18c54f0) 00002000:00010000:1.0:1784935551.176489:0:8987:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784935551 -> 1784935551 00010000:00010000:3.0:1784935551.176492:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784935551.176492:0:8987:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784935551.176498:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176506:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935551.176508:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935551.176511:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176517:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d454166ae00/0x857e02f4e0b16a6a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935551.176520:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640292092416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (515us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784935551.176527:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:3.0:1784935551.176528:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176534:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176540:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784935551.176543:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935551.176546:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784935551.176551:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935551.176554:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176557:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935551.176560:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176563:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b371d7f/0x857e02f4e0b16b9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176569:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:1.0:1784935551.176570:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935551.176571:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784935551.176574:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176575:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b371d7f/0x857e02f4e0b16b9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.176581:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16b6d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176583:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b371d7f/0x857e02f4e0b16b9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176595:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b371d7f/0x857e02f4e0b16b9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176602:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b371d7f/0x857e02f4e0b16b9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.176616:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935551.176617:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935551.176619:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784935551.176645:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d457402d180/2, rc 0, transno 4294967302 00000100:00100000:1.0:1784935551.176651:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292092544:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1784935551.176661:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d4574007480/2, rc 0, transno 4294967304 00000100:00100000:1.0:1784935551.176672:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292092416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784935551.186821:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.186900:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273141248 00000100:00100000:2.0:1784935551.186910:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273141248 00000100:00100000:2.0:1784935551.187009:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 38 00000100:00100000:2.0:1784935551.187024:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2392:x1871640273141248:12345-192.168.203.28@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1784935551.188379:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1784935551.188391:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1784935551.188488:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273141248:12345-192.168.203.28@tcp:16:lhsmtool_posix.0 Request processed in 1464us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935551.188497:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 38 00000100:00100000:1.0:1784935551.191815:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.191954:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273141504 00000100:00100000:2.0:1784935551.191965:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273141504 00000100:00100000:2.0:1784935551.192054:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 91 00000100:00100000:2.0:1784935551.192066:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+14:11269:x1871640273141504:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784935551.192137:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935551.192179:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16b89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9fd expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.192221:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:2.0:1784935551.192228:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935551.192261:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.192277:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.192300:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935551.192476:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006600cfbb reply state 0000000048697567 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.192489:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.192497:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:2.0:1784935551.192500:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784935551.192503:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784935551.192597:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+15:11269:x1871640273141504:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 533us (793us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1784935551.192604:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 91 00000100:00100000:3.0:1784935551.195610:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935551.195799:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273141632 00000100:00100000:1.0:1784935551.195810:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273141632 00000100:00100000:1.0:1784935551.195870:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 39 00000100:00100000:1.0:1784935551.195882:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273141632:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784935551.196101:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1784935551.196105:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1784935551 -> 1784935550 00002000:00010000:1.0:1784935551.196107:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784935549 00002000:00010000:1.0:1784935551.196110:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784935551 -> 1784935550 00002000:00010000:1.0:1784935551.196112:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1784935551.196170:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273141632:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 Request processed in 290us (570us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1784935551.196178:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 39 00000100:00100000:3.0:1784935551.204391:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.204472:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273141888 00000100:00100000:2.0:1784935551.204482:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273141888 00000100:00100000:2.0:1784935551.204532:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 92 00000100:00100000:2.0:1784935551.204540:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+15:11269:x1871640273141888:12345-192.168.203.28@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784935551.204605:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.204632:0:12375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16b66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9ef expref: 15 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.204642:0:12375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.204673:0:12375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16b66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9ef expref: 15 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.204686:0:12375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16b66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9ef expref: 15 pid: 7797 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935551.204700:0:12375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292092672:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935551.204814:0:12375:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2780 going to sleep for 11 seconds 00000100:00100000:2.0:1784935551.206737:0:12375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292092672:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935551.206762:0:12375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935551.210713:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935551.210979:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273142016 00000100:00100000:0.0:1784935551.210989:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273142016 00010000:00010000:0.0:1784935551.211027:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16b66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9ef expref: 16 pid: 7797 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935551.211073:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 60 00000100:00100000:0.0:1784935551.211083:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+16:2392:x1871640273142016:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935551.211098:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935551.211104:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16b66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9ef expref: 16 pid: 7797 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.211118:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16b66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9ef expref: 16 pid: 7797 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.211139:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16b66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9ef expref: 16 pid: 7797 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.211155:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:0.0:1784935551.211170:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.211179:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.211186:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.211218:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935551.211268:0:12375:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935551.211276:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+15:2392:x1871640273142016:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 195us (572us total) trans 0 rc 0/0 00010000:00010000:2.0:1784935551.211277:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935551.211284:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 60 00010000:00010000:2.0:1784935551.211331:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.211339:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.211352:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.211358:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935551.211362:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.211371:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.211380:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:2.0:1784935551.211382:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784935551.211386:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.211392:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bac lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935551.211462:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+14:11269:x1871640273141888:12345-192.168.203.28@tcp:55:lhsmtool_posix.0 Request processed in 6921us (7079us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784935551.211471:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 92 00000100:00100000:3.0:1784935551.216743:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.217680:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273142144 00000100:00100000:2.0:1784935551.217693:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273142144 00000100:00100000:2.0:1784935551.217756:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 40 00000100:00100000:2.0:1784935551.217765:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273142144:12345-192.168.203.28@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784935551.217806:0:8987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.217826:0:8987:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.217842:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935551.217846:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784935551.217851:0:8987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.217888:0:8987:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.217902:0:8987:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 7 pid: 8441 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935551.217917:0:8987:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8987:1871640292092800:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935551.218022:0:8987:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2780 going to sleep for 11 seconds 00000100:00100000:2.0:1784935551.222318:0:8987:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8987:1871640292092800:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935551.222346:0:8987:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935551.224425:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.224840:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273142272 00000100:00100000:2.0:1784935551.224849:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273142272 00010000:00010000:2.0:1784935551.224888:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 8 pid: 8441 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935551.224944:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 61 00000100:00100000:2.0:1784935551.224955:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2392:x1871640273142272:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935551.224989:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935551.225012:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 8 pid: 8441 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.225025:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 8 pid: 8441 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.225045:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b16b97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa0b expref: 8 pid: 8441 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.225060:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784935551.225064:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784935551.225069:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.225079:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.225104:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935551.225156:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273142272:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 202us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935551.225163:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 61 00010000:00010000:3.0:1784935551.225920:0:8987:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.225949:0:8987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.225970:0:8987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.225992:0:8987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.226001:0:8987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.226008:0:8987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935551.226013:0:8987:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.226022:0:8987:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.226039:0:8987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.226047:0:8987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b16bb3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935551.226517:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273142144:12345-192.168.203.28@tcp:1:lhsmtool_posix.0 Request processed in 8750us (9781us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935551.226527:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 40 00000100:00100000:1.0:1784935551.239364:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.239438:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273142528 00000100:00100000:2.0:1784935551.239456:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273142528 00000100:00100000:2.0:1784935551.239516:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 93 00000100:00100000:2.0:1784935551.239525:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+14:11269:x1871640273142528:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784935551.239603:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.239621:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b169fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a994 expref: 14 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.239630:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.239667:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b169fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a994 expref: 14 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.239681:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b169fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a994 expref: 14 pid: 12375 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935551.239696:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292092928:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935551.239774:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2780 going to sleep for 11 seconds 00000100:00100000:1.0:1784935551.243195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.243349:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292092928:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935551.243378:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935551.244017:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273142656 00000100:00100000:3.0:1784935551.244026:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273142656 00010000:00010000:3.0:1784935551.244062:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b169fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a994 expref: 15 pid: 12375 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935551.244102:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 62 00000100:00100000:3.0:1784935551.244127:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45729c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+15:2392:x1871640273142656:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935551.244142:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935551.244150:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b169fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a994 expref: 15 pid: 12375 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.244163:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b169fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a994 expref: 15 pid: 12375 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.244185:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b169fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a994 expref: 15 pid: 12375 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.244198:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:3.0:1784935551.244203:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.244212:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.244219:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.244255:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935551.244326:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45729c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+14:2392:x1871640273142656:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 201us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935551.244333:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 62 00010000:00010000:0.0:1784935551.245440:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.245462:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.245630:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.245644:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b74 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9f6 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.245652:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.245683:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9f6 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.245697:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b74 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9f6 expref: 14 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935551.245726:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d396300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292093056:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935551.245809:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a540 going to sleep for 11 seconds 00000100:00100000:2.0:1784935551.249305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935551.249347:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273142784 00000100:00100000:2.0:1784935551.249355:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273142784 00010000:00010000:2.0:1784935551.249391:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b74 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9f6 expref: 15 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935551.249440:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 63 00000100:00100000:2.0:1784935551.249462:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+15:2391:x1871640273142784:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935551.249479:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935551.249486:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b74 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9f6 expref: 15 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.249499:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b74 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9f6 expref: 15 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.249521:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:2.0:1784935551.249526:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.249536:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.249544:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935551.249567:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935551.249616:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+15:2391:x1871640273142784:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 167us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935551.249623:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 63 00010000:00010000:3.0:1784935551.250076:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b16b74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9f6 expref: 14 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935551.250095:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d396300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292093056:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935551.250126:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.250134:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935551.250139:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784935551.250252:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1784935551.250391:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1784935551.250430:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1784935551.250505:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6525:1871640292093184:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784935551.250586:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935551.250622:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474299c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935551.250633:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292093184 00000100:00100000:0.0:1784935551.250639:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292093184 00000100:00100000:0.0:1784935551.250682:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784935551.250690:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1871640292093184:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784935551.250765:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1871640292093184:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935551.250771:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784935551.250798:0:6525:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1784935551.250803:0:6525:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d4574007480, transno 4294967304 00000100:00100000:0.0:1784935551.250814:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6525:1871640292093184:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1784935551.250922:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1784935551.250988:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d396d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6525:1871640292093312:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784935551.251026:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935551.251043:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f1600 going to sleep for 11 seconds 00000100:00100000:0.0:1784935551.251111:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292093312 00000100:00100000:0.0:1784935551.251116:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292093312 00000100:00100000:0.0:1784935551.251150:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784935551.251158:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1871640292093312:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784935551.251246:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6525:x1871640292093312:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (219us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784935551.251252:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784935551.251281:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d396d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6525:1871640292093312:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1784935551.251326:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251336:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251344:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251350:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935551.251354:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251746:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251765:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:0.0:1784935551.251768:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784935551.251772:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251779:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16bc1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251810:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16aef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251816:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16aef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251822:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16aef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251837:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935551.251840:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16aef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251847:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16aef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251857:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:0.0:1784935551.251871:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784935551.251876:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16aef lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251882:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16aef lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251905:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251918:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9da expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.251946:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.252442:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9da expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.252473:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9da expref: 17 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935551.252499:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d396a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292093440:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935551.252569:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474299c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935551.257203:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d396a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292093440:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935551.257235:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935551.257881:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935551.257975:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273142912 00000100:00100000:0.0:1784935551.257983:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273142912 00010000:00010000:0.0:1784935551.258019:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9da expref: 18 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935551.258053:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 64 00000100:00100000:0.0:1784935551.258062:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+18:2392:x1871640273142912:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935551.258076:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935551.258082:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9da expref: 18 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258094:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9da expref: 18 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258115:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16b0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313a9da expref: 18 pid: 6527 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258132:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:0.0:1784935551.258137:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258171:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258178:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258203:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935551.258254:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+17:2392:x1871640273142912:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 192us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935551.258262:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 64 00010000:00010000:0.0:1784935551.258359:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258378:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258389:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258396:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258402:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258408:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935551.258412:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258419:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258435:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:0.0:1784935551.258438:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935551.258442:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258448:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16bc8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258470:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258476:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258481:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258486:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935551.258489:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258495:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258502:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d457d166d00) 00010000:00010000:0.0:1784935551.258504:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784935551.258507:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.258513:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bba lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935551.258671:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+16:11269:x1871640273142528:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 19145us (19315us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1784935551.258679:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 93 00000020:00080000:0.0:1784935551.258683:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784935551.258821:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935551.258827:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784935551.258842:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784935551.258857:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784935551.261425:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935551.261528:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273143168 00000100:00100000:1.0:1784935551.261539:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273143168 00000100:00100000:1.0:1784935551.261594:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:1.0:1784935551.261603:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+16:11269:x1871640273143168:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784935551.261854:0:6528:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784935551.261885:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1784935551.261916:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b16bcf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.261962:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b16bcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.261998:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b16bcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.262006:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b16bcf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.262012:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b16bcf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.262017:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b16bcf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935551.262041:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784935551.262121:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+18:11269:x1871640273143168:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 518us (704us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1784935551.262127:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 20 00000020:00080000:1.0:1784935551.262132:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784935551.262223:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935551.262231:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b16bcf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.262238:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935551.262241:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b16bcf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.262248:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b16bcf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.262262:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:0.0:1784935551.262265:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784935551.262269:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b16bcf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.262275:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b16bcf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935551.262287:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935551.262289:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935551.262290:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784935551.981475:0:14212:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784935551.981484:0:14212:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784935551.981519:0:14212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784935551.981528:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784935552.106515:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.106561:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273143424 00000100:00100000:0.0:1784935552.106571:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273143424 00000100:00100000:0.0:1784935552.106630:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 94 00000100:00100000:0.0:1784935552.106640:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+18:11286:x1871640273143424:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935552.106662:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935552.106680:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16bd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa12 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.106781:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699a00/0x857e02f4e0b16bdd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.106795:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699a00/0x857e02f4e0b16bdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.106808:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699a00/0x857e02f4e0b16bdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935552.106818:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784935552.107211:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16bd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa12 expref: 21 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.107226:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699a00/0x857e02f4e0b16bdd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa12 expref: 20 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.107234:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935552.107238:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784935552.107241:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699a00, rc 0) 00000100:00100000:0.0:1784935552.108172:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+20:11286:x1871640273143424:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 1530us (1663us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1784935552.108197:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 94 00000100:00080000:0.0:1784935552.108226:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784935552.112165:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935552.118235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.118395:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273143552 00000100:00100000:2.0:1784935552.118405:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273143552 00000100:00100000:2.0:1784935552.118459:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 95 00000100:00100000:2.0:1784935552.118468:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+20:11286:x1871640273143552:12345-192.168.203.28@tcp:34:lfs.0 00010000:00010000:2.0:1784935552.118539:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16beb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118555:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16beb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118566:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16beb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118580:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118586:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118592:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118658:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118665:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118670:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935552.118708:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118732:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16beb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118737:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16beb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118743:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16beb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118749:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.118752:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16beb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118759:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16beb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118769:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:2.0:1784935552.118772:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935552.118775:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16beb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118781:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16beb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118792:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118798:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bf2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118803:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118811:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.118814:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118819:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118826:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d4442a6b500) 00010000:00010000:2.0:1784935552.118828:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935552.118830:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bf2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.118835:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16bf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.121174:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.121191:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bf9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.121200:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.121206:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.121210:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.121220:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bf9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.121246:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b200) 00010000:00010000:2.0:1784935552.121249:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935552.121254:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bf9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.121261:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16bf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935552.121436:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+20:11286:x1871640273143552:12345-192.168.203.28@tcp:34:lfs.0 Request processed in 2965us (3206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935552.121446:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 95 00000100:00100000:0.0:1784935552.154004:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.154095:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273143808 00000100:00100000:2.0:1784935552.154104:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273143808 00000100:00100000:2.0:1784935552.154178:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 96 00000100:00100000:2.0:1784935552.154187:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+20:11289:x1871640273143808:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935552.154206:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935552.154232:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16c00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa19 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154313:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c07 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154328:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154340:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154355:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154374:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154380:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154489:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154496:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154503:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935552.154512:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1784935552.154582:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154589:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c07 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154595:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154601:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.154605:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154613:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154635:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:2.0:1784935552.154641:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935552.154646:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154651:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154664:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154670:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154676:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154681:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.154683:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154689:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154696:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d4442a6b200) 00010000:00010000:2.0:1784935552.154698:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935552.154701:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154706:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154756:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16c00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa19 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154769:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa19 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.154775:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:2.0:1784935552.154778:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935552.154780:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201200, rc 0) 00000100:00100000:2.0:1784935552.154842:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+22:11289:x1871640273143808:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 655us (846us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1784935552.154849:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 96 00000100:00100000:2.0:1784935552.160429:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.160510:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273143936 00000100:00100000:0.0:1784935552.160520:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273143936 00000100:00100000:0.0:1784935552.160575:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 97 00000100:00100000:0.0:1784935552.160585:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+22:11289:x1871640273143936:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:0.0:1784935552.160647:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.160664:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.160676:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.160711:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.160718:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.160724:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.160730:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935552.160734:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.160759:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.160772:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:0.0:1784935552.160775:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784935552.160780:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.160786:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935552.160867:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+22:11289:x1871640273143936:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 282us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935552.160874:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 97 00000100:00100000:1.0:1784935552.165375:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.165977:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273144192 00000100:00100000:0.0:1784935552.165987:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273144192 00000100:00100000:0.0:1784935552.166035:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:0.0:1784935552.166045:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a08450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+22:11289:x1871640273144192:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:0.0:1784935552.166549:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a08450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+23:11289:x1871640273144192:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 503us (1181us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1784935552.166558:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:3.0:1784935552.209382:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.209555:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273144448 00000100:00100000:2.0:1784935552.209575:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273144448 00000100:00100000:2.0:1784935552.209651:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 98 00000100:00100000:2.0:1784935552.209662:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+23:10812:x1871640273144448:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:2.0:1784935552.209686:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935552.209706:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16c2a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa20 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.209809:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.209825:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa19 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.209854:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.209888:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa19 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.209902:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa19 expref: 24 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935552.209916:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1871640292093568:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935552.210055:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2780 going to sleep for 11 seconds 00000100:00100000:3.0:1784935552.213512:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.213590:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273144576 00000100:00100000:0.0:1784935552.213599:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273144576 00010000:00010000:0.0:1784935552.213649:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c15 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa19 expref: 25 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935552.213693:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 65 00000100:00100000:0.0:1784935552.213702:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+25:2392:x1871640273144576:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935552.213730:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935552.213738:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c15 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa19 expref: 25 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.213751:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa19 expref: 25 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.213773:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:0.0:1784935552.213778:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.213787:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.213794:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.213811:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935552.213867:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+25:2392:x1871640273144576:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 165us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935552.213875:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 65 00010000:00010000:2.0:1784935552.214655:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa19 expref: 24 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935552.214676:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1871640292093568:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935552.214700:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.214709:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.214715:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935552.214732:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1784935552.214863:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16c2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa20 expref: 25 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.214896:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa20 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.214905:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:2.0:1784935552.214908:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784935552.214910:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200400, rc 0) 00000100:00100000:2.0:1784935552.214999:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+24:10812:x1871640273144448:12345-192.168.203.28@tcp:101:bash.0 Request processed in 5339us (5627us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1784935552.215007:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 98 00000100:00100000:3.0:1784935552.220700:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.221227:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273144704 00000100:00100000:0.0:1784935552.221238:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273144704 00000100:00100000:0.0:1784935552.221662:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 99 00000100:00100000:0.0:1784935552.221675:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+24:10812:x1871640273144704:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:0.0:1784935552.221701:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935552.221726:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa27 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.221781:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b16c46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.221795:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b16c46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.221807:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b16c46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.222391:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa27 expref: 26 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.222413:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b16c46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa27 expref: 25 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.222492:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:0.0:1784935552.222495:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784935552.222498:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699200, rc 0) 00000100:00100000:0.0:1784935552.222614:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+25:10812:x1871640273144704:12345-192.168.203.28@tcp:101:bash.0 Request processed in 942us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935552.222622:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 99 00000100:00100000:3.0:1784935552.225768:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.226130:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273144960 00000100:00100000:2.0:1784935552.226139:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273144960 00000100:00100000:2.0:1784935552.226194:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 100 00000100:00100000:2.0:1784935552.226204:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+25:10812:x1871640273144960:12345-192.168.203.28@tcp:36:bash.0 00010000:00010000:2.0:1784935552.226494:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.226510:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.226522:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784935552.226560:0:12375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1784935552.226580:0:12375:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000055feb3a9 reply state 00000000cae7e4ef transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.226592:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.226717:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:2.0:1784935552.226720:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784935552.226724:0:12375:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1784935552.226793:0:12375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1784935552.226985:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+29:10812:x1871640273144960:12345-192.168.203.28@tcp:36:bash.0 Request processed in 781us (1222us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1784935552.226993:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 100 00000020:00080000:2.0:1784935552.226998:0:12375:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1784935552.229620:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.229729:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273145088 00000100:00100000:2.0:1784935552.229740:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273145088 00000100:00100000:2.0:1784935552.229805:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 101 00000100:00100000:2.0:1784935552.229814:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+29:10812:x1871640273145088:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:2.0:1784935552.229837:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935552.229856:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16c54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa2e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.229911:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16c54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa2e expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.230006:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16c54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa2e expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.230026:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:2.0:1784935552.230030:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784935552.230033:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200e00, rc 0) 00000100:00100000:2.0:1784935552.230086:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+30:10812:x1871640273145088:12345-192.168.203.28@tcp:101:bash.0 Request processed in 273us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935552.230109:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 101 00000100:00100000:3.0:1784935552.234616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935552.234748:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273145216 00000100:00100000:1.0:1784935552.234757:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273145216 00000100:00100000:1.0:1784935552.234819:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 41 00000100:00100000:1.0:1784935552.234829:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:10812:x1871640273145216:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935552.235172:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935552.235195:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d554100f/0x857e02f4e0b16c5b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa35 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784935552.235219:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a63f47e, atime: 0x6a63f47d, ctime: 0x6a63f47e, blocks: 0x8 00010000:00010000:1.0:1784935552.235254:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1784935552.235259:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935552.235267:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d554100f/0x857e02f4e0b16c5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa35 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.235414:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d554100f/0x857e02f4e0b16c5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa35 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.235495:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8000, rc 0) 00000100:00100000:1.0:1784935552.235610:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:10812:x1871640273145216:12345-192.168.203.28@tcp:101:bash.0 Request processed in 781us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935552.235617:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 41 00000100:00100000:1.0:1784935552.240371:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.244128:0:8444:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273145344 00000100:00100000:2.0:1784935552.244144:0:8444:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273145344 00002000:00010000:2.0:1784935552.244193:0:8444:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1784935552.244198:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4574004e00 with x1871640273145344 ext(0->18446744073709551615) 00002000:00010000:2.0:1784935552.244211:0:8444:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4574004e00. 00000100:00100000:2.0:1784935552.244256:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 1 00000100:00100000:2.0:1784935552.244266:0:8444:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273145344:12345-192.168.203.28@tcp:10:bash.0 00002000:00010000:2.0:1784935552.244875:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1784935552.244880:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1784935550 -> 1784935552 00002000:00010000:2.0:1784935552.244883:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1784935549 -> 1784935549 00002000:00010000:2.0:1784935552.244885:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784935550 -> 1784935552 00002000:00010000:2.0:1784935552.244888:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1784935552.245055:0:8444:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273145344:12345-192.168.203.28@tcp:10:bash.0 Request processed in 788us (4692us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784935552.245064:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 1 00002000:00010000:2.0:1784935552.245069:0:8444:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1784935552.245072:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4574004e00 with x1871640273145344 ext(0->18446744073709551615) 00002000:00010000:2.0:1784935552.245077:0:8444:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4574004e00. 00000100:00100000:3.0:1784935552.325230:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.328184:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273145472 00000100:00100000:0.0:1784935552.328199:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273145472 00000100:00100000:0.0:1784935552.328276:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 102 00000100:00100000:0.0:1784935552.328286:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+30:11303:x1871640273145472:12345-192.168.203.28@tcp:34:lfs.0 00010000:00010000:0.0:1784935552.328371:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c62 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328404:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328414:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328431:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16c69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328438:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16c69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328444:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16c69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328518:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328527:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328534:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784935552.328577:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328703:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328711:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c62 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328727:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328733:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935552.328737:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328745:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c62 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328821:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935552.328825:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935552.328830:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328836:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16c62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328849:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16c69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328854:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16c69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328859:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16c69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328864:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935552.328867:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16c69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328883:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16c69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328976:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d45705a8600) 00010000:00010000:0.0:1784935552.328980:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935552.328983:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16c69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.328989:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16c69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.329003:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.329008:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.329013:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.329017:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935552.329020:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.329025:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.329032:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:0.0:1784935552.329034:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935552.329037:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.329051:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935552.329132:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+30:11303:x1871640273145472:12345-192.168.203.28@tcp:34:lfs.0 Request processed in 846us (3910us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935552.329141:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 102 00000100:00100000:3.0:1784935552.370857:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.371301:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273145728 00000100:00100000:2.0:1784935552.371328:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273145728 00000100:00100000:2.0:1784935552.371392:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 103 00000100:00100000:2.0:1784935552.371402:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+30:11306:x1871640273145728:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935552.371420:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935552.371450:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa3c expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371531:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16c7e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371545:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16c7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371556:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16c7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371569:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16c85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371576:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371582:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371678:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16c8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371687:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16c8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371694:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16c8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935552.371704:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784935552.371777:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16c7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371794:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16c7e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371800:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16c7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371806:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.371810:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16c7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371818:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16c7e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371830:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:2.0:1784935552.371833:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935552.371837:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16c7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371842:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16c7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371858:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371864:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16c85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371870:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16c85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371875:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.371884:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16c85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371890:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16c85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371898:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d4442a6b200) 00010000:00010000:2.0:1784935552.371900:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935552.371903:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16c85 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.371909:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16c85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.372000:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16c77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa3c expref: 33 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.372013:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16c8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa3c expref: 32 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.372026:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:2.0:1784935552.372028:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784935552.372030:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200a00, rc 0) 00000100:00100000:2.0:1784935552.372094:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+32:11306:x1871640273145728:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 693us (1245us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1784935552.372101:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 103 00000100:00100000:3.0:1784935552.379356:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.379427:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273145856 00000100:00100000:0.0:1784935552.379438:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273145856 00000100:00100000:0.0:1784935552.379510:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 104 00000100:00100000:0.0:1784935552.379520:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+32:11306:x1871640273145856:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:0.0:1784935552.379585:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.379601:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa20 expref: 32 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.379610:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.379642:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa20 expref: 32 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.379655:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa20 expref: 32 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935552.379669:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d394a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292093696:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935552.379764:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4541254600 going to sleep for 11 seconds 00000100:00100000:3.0:1784935552.382573:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935552.382715:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273146112 00000100:00100000:1.0:1784935552.382724:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273146112 00000100:00100000:1.0:1784935552.382775:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:1.0:1784935552.382785:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+33:6159:x1871640273146112:12345-192.168.203.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784935552.383096:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+34:6159:x1871640273146112:12345-192.168.203.28@tcp:35:ldlm_bl.0 Request processed in 311us (531us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1784935552.383104:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:0.0:1784935552.383467:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d394a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292093696:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935552.383491:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935552.384846:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.388506:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273146240 00000100:00100000:0.0:1784935552.388522:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273146240 00010000:00010000:0.0:1784935552.388569:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa20 expref: 34 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935552.388618:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 66 00000100:00100000:0.0:1784935552.388627:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+34:2391:x1871640273146240:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935552.388643:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935552.388650:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa20 expref: 34 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.388664:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa20 expref: 34 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.388685:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16c31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa20 expref: 34 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.388704:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:0.0:1784935552.388710:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.388720:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.388728:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.389435:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935552.389503:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+33:2391:x1871640273146240:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 875us (4660us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935552.389512:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 66 00010000:00010000:1.0:1784935552.391800:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.391817:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.391880:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.391887:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.391894:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.391900:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935552.391904:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.391912:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.392417:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:1.0:1784935552.392422:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784935552.392427:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.392435:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16c9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935552.392555:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+32:11306:x1871640273145856:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 13033us (13205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935552.392564:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 104 00000100:00100000:1.0:1784935552.402744:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.402844:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273146496 00000100:00100000:2.0:1784935552.402854:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273146496 00000100:00100000:2.0:1784935552.402908:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:2.0:1784935552.402917:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+32:11306:x1871640273146496:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:2.0:1784935552.403487:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+33:11306:x1871640273146496:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 569us (751us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1784935552.403495:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:2.0:1784935552.429438:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292093824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935552.429528:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935552.429701:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292093824 00000100:00100000:0.0:1784935552.429709:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292093824 00000100:00100000:0.0:1784935552.429759:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784935552.429769:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292093824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935552.429803:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1784935552.429859:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292093824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935552.429867:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784935552.430443:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292093824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935552.513114:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.513597:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273146752 00000100:00100000:0.0:1784935552.513608:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273146752 00000100:00100000:0.0:1784935552.513667:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 105 00000100:00100000:0.0:1784935552.513677:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+33:11317:x1871640273146752:12345-192.168.203.28@tcp:101:cat.0 00010000:00010000:0.0:1784935552.513702:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935552.513723:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16ca1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa43 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.513794:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16ca8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.513808:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.513819:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.513849:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16caf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.513857:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16caf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.513863:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16caf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514032:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16cb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514042:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514050:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935552.514059:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1784935552.514128:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514136:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16ca8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514143:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514149:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935552.514153:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514171:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16ca8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514182:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935552.514184:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935552.514189:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16ca8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514196:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16ca8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514208:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16caf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514214:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16caf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514219:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16caf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514223:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935552.514227:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16caf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514245:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16caf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514252:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d45705a8600) 00010000:00010000:0.0:1784935552.514255:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935552.514258:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16caf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514286:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16caf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514562:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16ca1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa43 expref: 36 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514577:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa43 expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.514585:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:0.0:1784935552.514588:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935552.514591:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698000, rc 0) 00000100:00100000:0.0:1784935552.514644:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+35:11317:x1871640273146752:12345-192.168.203.28@tcp:101:cat.0 Request processed in 968us (1537us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1784935552.514651:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 105 00000100:00100000:3.0:1784935552.523733:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.523871:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273147008 00000100:00100000:0.0:1784935552.523880:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273147008 00000100:00100000:0.0:1784935552.523959:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:0.0:1784935552.524034:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+35:11317:x1871640273147008:12345-192.168.203.28@tcp:35:cat.0 00000100:00100000:0.0:1784935552.524544:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+36:11317:x1871640273147008:12345-192.168.203.28@tcp:35:cat.0 Request processed in 513us (818us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1784935552.524553:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:1.0:1784935552.546990:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.547148:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273147264 00000100:00100000:2.0:1784935552.547159:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273147264 00000100:00100000:2.0:1784935552.547216:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 106 00000100:00100000:2.0:1784935552.547226:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+36:11318:x1871640273147264:12345-192.168.203.28@tcp:36:rm.0 00010000:00010000:2.0:1784935552.547281:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1784935552.547430:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16c54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa2e expref: 36 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.547605:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16cb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa43 expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.547622:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16c8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa3c expref: 34 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.548422:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b16c46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa27 expref: 33 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.548441:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:2.0:1784935552.548548:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935552.548576:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16cc4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.548589:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16cc4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.548602:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16cc4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.548617:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.548625:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.548631:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.548707:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16cd2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.548717:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.548724:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784935552.548958:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1784935552.548970:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371799041931ns, next at 372799038837ns, rc = 0 00010000:00010000:2.0:1784935552.549017:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16cd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549037:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549046:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549054:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16cd9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549060:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16cd9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549067:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549093:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784935552.549114:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549121:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16cd2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549127:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16cd2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549134:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.549138:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16cd2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549145:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16cd2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549167:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:2.0:1784935552.549170:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784935552.549174:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16cd2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549180:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16cd2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549198:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16cc4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549204:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16cc4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549210:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16cc4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549215:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.549217:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16cc4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549223:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16cc4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549231:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:2.0:1784935552.549233:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935552.549236:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16cc4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.549241:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16cc4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935552.549262:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073e28408 reply state 0000000072f8852d transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.549646:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935552.549653:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16cd9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.549659:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935552.549669:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16cd9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.549677:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.549687:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:0.0:1784935552.549689:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784935552.549692:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16cd9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.549699:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16cd9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.549710:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935552.549712:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935552.549714:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935552.550873:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.550892:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d4442a6b200) 00010000:00010000:2.0:1784935552.550895:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784935552.550898:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784935552.551023:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+34:11318:x1871640273147264:12345-192.168.203.28@tcp:36:rm.0 Request processed in 3794us (4038us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1784935552.551033:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 106 00000100:00100000:2.0:1784935552.590637:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935552.591414:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273147520 00000100:00100000:1.0:1784935552.591441:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273147520 00000100:00100000:1.0:1784935552.591706:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 107 00000100:00100000:1.0:1784935552.591716:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+34:11324:x1871640273147520:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935552.591739:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935552.591760:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b16ce0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa4a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.591855:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b16ce7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.591870:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b16ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.591882:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b16ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.591895:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.591903:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.591910:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784935552.592227:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1784935552.592873:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16cf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.592886:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.592909:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.592978:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b16ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.592985:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b16ce7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.592992:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b16ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.592998:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935552.593003:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b16ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.593010:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b16ce7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.593022:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:1.0:1784935552.593025:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935552.593030:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b16ce7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.593037:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b16ce7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784935552.593051:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006fd14dcc reply state 00000000d7ed175b transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.593062:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.593075:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d4442a6b200) 00010000:00010000:1.0:1784935552.593077:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784935552.593080:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784935552.593111:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b16ce0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa4a expref: 37 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.593126:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa4a expref: 36 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.593133:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d457d166300) 00010000:00010000:1.0:1784935552.593135:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935552.593137:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9c00, rc 0) 00000100:00100000:1.0:1784935552.593211:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+37:11324:x1871640273147520:12345-192.168.203.28@tcp:101:bash.0 Request processed in 1495us (2583us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1784935552.593220:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 107 00000100:00100000:3.0:1784935552.597457:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935552.597547:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273147648 00000100:00100000:1.0:1784935552.597556:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273147648 00000100:00100000:1.0:1784935552.597635:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 42 00000100:00100000:1.0:1784935552.597645:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2393:x1871640273147648:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935552.597663:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935552.597688:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b16d03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa51 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784935552.597713:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935552.597732:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1784935552.597737:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935552.597759:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b16d03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa51 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.597778:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b16d03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa51 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.597791:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9000, rc 0) 00000100:00100000:1.0:1784935552.597851:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2393:x1871640273147648:12345-192.168.203.28@tcp:101:bash.0 Request processed in 207us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935552.597858:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 42 00000100:00080000:0.0:1784935552.601922:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935552.602713:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.602864:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273147776 00000100:00100000:0.0:1784935552.602874:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273147776 00000100:00100000:0.0:1784935552.602947:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 43 00000100:00100000:0.0:1784935552.602957:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+8:11324:x1871640273147776:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:0.0:1784935552.602983:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935552.603000:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa58 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.603032:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b16d03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa51 expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.603041:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935552.603051:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935552.603057:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.603090:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b16d03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa51 expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.603103:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b16d03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa51 expref: 9 pid: 8441 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935552.603118:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d394a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1871640292093952:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935552.603248:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45412543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935552.606020:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935552.606086:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273147904 00000100:00100000:1.0:1784935552.606094:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273147904 00010000:00010000:1.0:1784935552.606134:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b16d03 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa51 expref: 10 pid: 8441 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935552.606169:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 67 00000100:00100000:1.0:1784935552.606179:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+10:2391:x1871640273147904:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935552.606193:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935552.606215:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b16d03 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa51 expref: 10 pid: 8441 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.606228:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b16d03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa51 expref: 10 pid: 8441 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.606253:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935552.606257:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935552.606286:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.606297:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.606351:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935552.606366:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574005180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6510:1871640292094080:192.168.203.28@tcp:105: 00010000:00010000:0.0:1784935552.606480:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b16d03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa51 expref: 10 pid: 8441 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935552.606494:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d394a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1871640292093952:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935552.606518:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.606529:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698400, rc 0) 00000100:00100000:1.0:1784935552.606883:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e34be40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935552.606951:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+9:11324:x1871640273147776:12345-192.168.203.28@tcp:101:bash.0 Request processed in 3994us (4244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935552.607013:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 43 00000100:00100000:0.0:1784935552.610443:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574005180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6510:1871640292094080:192.168.203.28@tcp:105: 00010000:00010000:0.0:1784935552.610472:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935552.610532:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273147904:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 4353us (4521us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935552.610542:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 67 00000100:00100000:3.0:1784935552.610650:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.611034:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273148160 00000100:00100000:2.0:1784935552.611043:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273148160 00000100:00100000:2.0:1784935552.611090:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:2.0:1784935552.611099:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+37:11324:x1871640273148160:12345-192.168.203.28@tcp:35:bash.0 00000100:00100000:2.0:1784935552.611391:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+38:11324:x1871640273148160:12345-192.168.203.28@tcp:35:bash.0 Request processed in 292us (739us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1784935552.611399:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:3.0:1784935552.746711:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.746816:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273148288 00000100:00100000:0.0:1784935552.746825:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273148288 00000100:00100000:0.0:1784935552.746885:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 108 00000100:00100000:0.0:1784935552.746895:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+38:11340:x1871640273148288:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935552.746920:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935552.746975:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16d11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa5f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.747036:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16d18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.747049:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16d18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.747059:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16d18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935552.747099:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784935552.747102:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935552.747119:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16d18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.747141:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16d11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa5f expref: 40 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.747158:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16d18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa5f expref: 39 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.747185:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935552.747188:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784935552.747191:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698c00, rc 0) 00000100:00100000:0.0:1784935552.747256:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+39:11340:x1871640273148288:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 363us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935552.747262:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 108 00000100:00100000:3.0:1784935552.759061:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.759258:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273148544 00000100:00100000:2.0:1784935552.759272:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273148544 00000100:00100000:2.0:1784935552.759373:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 109 00000100:00100000:2.0:1784935552.759383:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+39:11340:x1871640273148544:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935552.759402:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935552.759424:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa66 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.759543:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.759557:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.759568:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935552.759580:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784935552.759680:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa66 expref: 42 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.759698:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa66 expref: 41 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.759706:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d457d166300) 00010000:00010000:2.0:1784935552.759709:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935552.759712:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200a00, rc 0) 00000100:00100000:2.0:1784935552.759770:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+41:11340:x1871640273148544:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 389us (719us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1784935552.759778:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 109 00000100:00100000:1.0:1784935552.766115:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.766209:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273148800 00000100:00100000:0.0:1784935552.766220:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273148800 00000100:00100000:0.0:1784935552.766292:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 110 00000100:00100000:0.0:1784935552.766311:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+41:11340:x1871640273148800:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935552.766335:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935552.766354:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16d34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa6d expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.766455:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16d3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.766469:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16d3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.766479:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16d3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935552.766491:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784935552.766597:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16d34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa6d expref: 44 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.766636:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16d3b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa6d expref: 43 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.766645:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d457d166300) 00010000:00010000:0.0:1784935552.766648:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784935552.766651:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699600, rc 0) 00000100:00100000:0.0:1784935552.766714:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+43:11340:x1871640273148800:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 413us (608us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1784935552.766721:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 110 00000100:00100000:3.0:1784935552.771228:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.771401:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273148928 00000100:00100000:0.0:1784935552.771411:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273148928 00000100:00100000:0.0:1784935552.771475:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:0.0:1784935552.771485:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+43:2393:x1871640273148928:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935552.771500:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935552.771522:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa66 expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.771541:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d457d166300) 00010000:00010000:0.0:1784935552.771545:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935552.771597:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+42:2393:x1871640273148928:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 113us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935552.771604:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:3.0:1784935552.778780:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935552.779140:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273149056 00000100:00100000:1.0:1784935552.779150:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273149056 00000100:00100000:1.0:1784935552.779242:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 44 00000100:00100000:1.0:1784935552.779253:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273149056:12345-192.168.203.28@tcp:1:lfs.0 00010000:00010000:1.0:1784935552.779315:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.779338:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.779346:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1784935552.779351:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784935552.779355:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.779423:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.779438:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 8 pid: 8439 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935552.779453:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1871640292094208:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935552.779538:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e34be40 going to sleep for 11 seconds 00000100:00100000:1.0:1784935552.783829:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.784094:0:8446:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273149184 00000100:00100000:2.0:1784935552.784103:0:8446:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273149184 00002000:00100000:2.0:1784935552.784150:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8d4443cf0380 x1871640273149184/t0(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:48/0 lens 504/0 e 0 to 0 dl 1784935563 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784935552.784161:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443cf0380 with x1871640273149184 ext(0->8) 00010000:00010000:2.0:1784935552.784184:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 9 pid: 8439 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.784200:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 9 pid: 8439 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935552.784209:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4443cf0380 00000100:00100000:2.0:1784935552.784244:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 1 00000100:00100000:2.0:1784935552.784253:0:8446:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2392:x1871640273149184:12345-192.168.203.28@tcp:4:lfs.0 00000100:00100000:2.0:1784935552.786591:0:8446:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+11:2392:x1871640273149184:12345-192.168.203.28@tcp:4:lfs.0 Request processed in 2327us (2772us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784935552.786606:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 1 00002000:00100000:2.0:1784935552.786619:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8d4443cf0380 x1871640273149184/t4294967303(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:48/0 lens 504/448 e 0 to 0 dl 1784935563 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784935552.786630:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443cf0380 with x1871640273149184 ext(0->8) 00010000:00010000:2.0:1784935552.786641:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 11 pid: 8439 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.786660:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 11 pid: 8439 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935552.786669:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4443cf0380 00000100:00100000:3.0:1784935552.786976:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1871640292094208:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935552.787001:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935552.799588:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935552.799854:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273149312 00000100:00100000:1.0:1784935552.799864:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273149312 00010000:00010000:1.0:1784935552.799901:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 11 pid: 8439 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935552.799976:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 68 00000100:00100000:1.0:1784935552.799986:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45729c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+11:2394:x1871640273149312:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935552.800001:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784935552.800017:0:6511:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1784935552.800020:0:6511:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784935552 00002000:00010000:1.0:1784935552.800023:0:6511:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784935552 00002000:00010000:1.0:1784935552.800025:0:6511:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1784935552 00002000:00010000:1.0:1784935552.800027:0:6511:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784935552.800033:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 11 pid: 8439 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.800069:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 11 pid: 8439 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.800094:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4844fd7/0x857e02f4e0b16d0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa58 expref: 11 pid: 8439 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.800112:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784935552.800116:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784935552.800122:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.800131:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.800164:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935552.800224:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45729c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+10:2394:x1871640273149312:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 239us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935552.800232:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 68 00010000:00010000:3.0:1784935552.800414:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.800425:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.800444:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.800452:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.800459:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.800467:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935552.800478:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.800487:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.800499:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.800506:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b16d49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935552.800552:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2391:x1871640273149056:12345-192.168.203.28@tcp:1:lfs.0 Request processed in 21301us (21782us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935552.800560:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 44 00000100:00100000:1.0:1784935552.804600:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.804683:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273149568 00000100:00100000:2.0:1784935552.804693:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273149568 00000100:00100000:2.0:1784935552.804748:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 26 00000100:00100000:2.0:1784935552.804758:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+42:11340:x1871640273149568:12345-192.168.203.28@tcp:35:lfs.0 00000004:00010000:2.0:1784935552.804853:0:6528:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16d3b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa6d expref: 42 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784935552.805206:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1784935552.805243:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1784935552.805665:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1784935552.805706:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.805723:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa4a expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.805733:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.805769:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa4a expref: 46 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.805784:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa4a expref: 46 pid: 6527 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935552.805798:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6528:1871640292094336:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935552.805898:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784935552.810335:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.810403:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273149696 00000100:00100000:0.0:1784935552.810413:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273149696 00010000:00010000:0.0:1784935552.810448:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16cf5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa4a expref: 47 pid: 6527 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935552.810512:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 69 00000100:00100000:0.0:1784935552.810522:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+47:2392:x1871640273149696:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935552.810539:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935552.810546:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16cf5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa4a expref: 47 pid: 6527 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.810559:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa4a expref: 47 pid: 6527 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.810581:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d457d166300) 00010000:00010000:0.0:1784935552.810587:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.810597:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.810605:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.810625:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935552.810684:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+47:2392:x1871640273149696:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 162us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935552.810692:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 69 00010000:00010000:1.0:1784935552.812377:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16cf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa4a expref: 46 pid: 6527 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935552.812400:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6528:1871640292094336:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935552.812422:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.812515:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.812522:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784935552.812632:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1784935552.812757:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1784935552.812854:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1871640292094464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784935552.812915:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935552.813094:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4544f9a180 going to sleep for 11 seconds 00000100:00100000:3.0:1784935552.813144:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292094464 00000100:00100000:3.0:1784935552.813152:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292094464 00000100:00100000:3.0:1784935552.813248:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784935552.813261:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6528:x1871640292094464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784935552.813371:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6528:x1871640292094464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 114us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935552.813379:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784935552.813438:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1871640292094464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784935552.813558:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1784935552.813599:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1871640292094592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784935552.813626:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935552.813917:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4559a0e180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935552.814130:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292094592 00000100:00100000:0.0:1784935552.814137:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292094592 00000100:00100000:0.0:1784935552.814170:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784935552.814178:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6528:x1871640292094592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784935552.814338:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6528:x1871640292094592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 160us (710us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1784935552.814345:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784935552.814480:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6528:1871640292094592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784935552.814521:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1784935552.814556:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.814566:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.814574:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.814580:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935552.814592:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.814601:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.814616:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d457d166300) 00010000:00010000:1.0:1784935552.814620:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784935552.814624:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935552.814632:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16d50 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784935552.814727:0:6528:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784935552.814786:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1784935552.814796:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372064867561ns, next at 373064865423ns, rc = 0 00000001:00080000:1.0:1784935552.814802:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1784935552.814824:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d457d166300) 00010000:00010000:1.0:1784935552.814827:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784935552.814833:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16d3b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa6d expref: 50 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935552.814953:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+49:11340:x1871640273149568:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 10196us (10364us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1784935552.814972:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 26 00000020:00080000:1.0:1784935552.814976:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784935552.817573:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935552.817678:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273149824 00000100:00100000:3.0:1784935552.817688:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273149824 00000100:00100000:3.0:1784935552.817740:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 111 00000100:00100000:3.0:1784935552.817749:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+49:11340:x1871640273149824:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935552.817772:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935552.817806:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16d57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa74 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.817860:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16d57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa74 expref: 50 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.817874:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16d57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa74 expref: 50 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.817893:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:3.0:1784935552.817896:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784935552.817899:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020800, rc 0) 00000100:00100000:3.0:1784935552.818152:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+50:11340:x1871640273149824:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 402us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935552.818160:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 111 00000100:00100000:0.0:1784935552.821547:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935552.821647:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273150080 00000100:00100000:3.0:1784935552.821657:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273150080 00000100:00100000:3.0:1784935552.821742:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 27 00000100:00100000:3.0:1784935552.821752:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+50:11340:x1871640273150080:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:3.0:1784935552.822023:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+51:11340:x1871640273150080:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 272us (484us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1784935552.822032:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 27 00000100:00100000:1.0:1784935552.904047:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935552.904172:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273150208 00000100:00100000:2.0:1784935552.904182:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273150208 00000100:00100000:2.0:1784935552.904241:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 112 00000100:00100000:2.0:1784935552.904252:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+51:11350:x1871640273150208:12345-192.168.203.28@tcp:34:lfs.0 00010000:00010000:2.0:1784935552.904488:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d5e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904506:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904518:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904530:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904538:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904545:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904614:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16d6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904622:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16d6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904629:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16d6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935552.904672:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16d6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904685:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904703:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d5e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904710:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904717:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.904721:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904729:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d5e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904740:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:2.0:1784935552.904742:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935552.904747:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904753:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16d5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904768:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904774:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904780:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904785:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.904794:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904800:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904809:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d4442a6b200) 00010000:00010000:2.0:1784935552.904812:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935552.904814:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904820:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b16d65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904831:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16d6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904836:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16d6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904842:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16d6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904847:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935552.904850:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16d6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904856:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16d6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904863:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:2.0:1784935552.904864:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935552.904875:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16d6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935552.904880:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16d6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935552.906171:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+51:11350:x1871640273150208:12345-192.168.203.28@tcp:34:lfs.0 Request processed in 1913us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935552.906183:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 112 00000100:00100000:2.0:1784935552.961616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935552.961710:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273150464 00000100:00100000:0.0:1784935552.961720:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273150464 00000100:00100000:0.0:1784935552.961804:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 113 00000100:00100000:0.0:1784935552.961814:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+51:11353:x1871640273150464:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935552.961842:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935552.961862:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16d73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa7b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.961960:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16d7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.961976:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16d7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.961988:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16d7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.961998:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16d81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.962005:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16d81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.962011:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16d81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963578:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16d88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963598:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16d88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963608:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16d88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935552.963620:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784935552.963704:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16d7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963712:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16d7a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963719:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16d7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963725:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935552.963729:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16d7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963737:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16d7a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963747:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935552.963750:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935552.963754:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16d7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963775:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16d7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963790:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16d81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963796:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16d81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963801:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16d81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963806:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935552.963809:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16d81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963816:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16d81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963824:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d4442a6b200) 00010000:00010000:0.0:1784935552.963836:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935552.963839:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16d81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963846:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16d81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963888:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16d73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa7b expref: 54 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963902:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16d88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa7b expref: 53 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935552.963916:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935552.963919:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935552.963921:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699600, rc 0) 00000100:00100000:0.0:1784935552.964030:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+53:11353:x1871640273150464:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 2217us (2424us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1784935552.964038:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 113 00000100:00100000:2.0:1784935552.973182:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935552.973272:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273150592 00000100:00100000:3.0:1784935552.973284:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273150592 00000100:00100000:3.0:1784935552.973359:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 114 00000100:00100000:3.0:1784935552.973368:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+53:11353:x1871640273150592:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:3.0:1784935552.973441:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16d96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.973470:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.973481:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.973516:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.973523:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16d96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.973530:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16d96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.973536:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935552.973540:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16d96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.973547:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16d96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.973558:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:3.0:1784935552.973561:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784935552.973565:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16d96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935552.973572:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16d96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935552.973645:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+53:11353:x1871640273150592:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 277us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935552.973658:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 114 00000100:00100000:3.0:1784935552.977097:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935552.977181:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273150848 00000100:00100000:1.0:1784935552.977204:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273150848 00000100:00100000:1.0:1784935552.977255:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 28 00000100:00100000:1.0:1784935552.977264:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+53:11353:x1871640273150848:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:1.0:1784935552.977511:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+54:11353:x1871640273150848:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 247us (421us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1784935552.977519:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 28 00000100:00100000:2.0:1784935553.118473:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935553.118803:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273151104 00000100:00100000:1.0:1784935553.118814:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273151104 00000100:00100000:2.0:1784935553.119476:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 115 00000100:00100000:2.0:1784935553.119490:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+54:11363:x1871640273151104:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:2.0:1784935553.119515:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935553.119520:0:12375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784935553.119545:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b16d18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa5f expref: 54 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.119576:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:2.0:1784935553.119581:0:12375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935553.119593:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16d9d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa82 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.120172:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16da4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.120188:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16da4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.120215:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16da4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935553.120228:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784935553.120341:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16d9d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa82 expref: 56 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.120357:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16da4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa82 expref: 55 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.120366:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:2.0:1784935553.120369:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935553.120372:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200c00, rc 0) 00000100:00100000:2.0:1784935553.120442:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+55:11363:x1871640273151104:12345-192.168.203.28@tcp:101:bash.0 Request processed in 956us (1979us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1784935553.120451:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 115 00000100:00100000:2.0:1784935553.126235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.126345:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273151232 00000100:00100000:0.0:1784935553.126360:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273151232 00000100:00100000:0.0:1784935553.126423:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 116 00000100:00100000:0.0:1784935553.126432:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+55:11363:x1871640273151232:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:0.0:1784935553.126456:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935553.126476:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16db2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa89 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.126507:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16db9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.126519:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16db9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.126530:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16db9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.126647:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16db2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa89 expref: 57 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.126665:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16db9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa89 expref: 56 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.126681:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935553.126684:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784935553.126688:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698a00, rc 0) 00000100:00100000:0.0:1784935553.126759:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+56:11363:x1871640273151232:12345-192.168.203.28@tcp:101:bash.0 Request processed in 319us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.126766:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 116 00000100:00100000:1.0:1784935553.129858:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935553.130095:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273151360 00000100:00100000:2.0:1784935553.130105:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273151360 00000100:00100000:2.0:1784935553.130170:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 8 00000100:00100000:2.0:1784935553.130179:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+56:2394:x1871640273151360:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935553.130194:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935553.130216:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16da4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa82 expref: 56 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.130236:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:2.0:1784935553.130251:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935553.130316:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+55:2394:x1871640273151360:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 139us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935553.130323:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 8 00000100:00100000:3.0:1784935553.131136:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.131394:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273151616 00000100:00100000:0.0:1784935553.131400:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273151616 00000100:00100000:0.0:1784935553.131441:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 117 00000100:00100000:0.0:1784935553.131453:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+55:11363:x1871640273151616:12345-192.168.203.28@tcp:36:bash.0 00010000:00010000:0.0:1784935553.131501:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935553.131522:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16d88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa7b expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.131538:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935553.131542:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784935553.131697:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.131712:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.131720:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784935553.131772:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1784935553.131794:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5e95501 reply state 00000000ad004afa transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.131817:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.131824:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935553.131827:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784935553.131829:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784935553.131913:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+57:11363:x1871640273151616:12345-192.168.203.28@tcp:36:bash.0 Request processed in 461us (779us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1784935553.131920:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 117 00000020:00080000:0.0:1784935553.131924:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784935553.134033:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935553.134328:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273151744 00000100:00100000:1.0:1784935553.134338:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273151744 00000100:00100000:1.0:1784935553.134393:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 118 00000100:00100000:1.0:1784935553.134402:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+57:11363:x1871640273151744:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935553.134426:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935553.134444:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16dc7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa90 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.134596:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.134610:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.134621:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935553.134649:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784935553.134654:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935553.134670:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.134708:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16dc7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa90 expref: 59 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.134726:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa90 expref: 58 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.134734:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:1.0:1784935553.134737:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935553.134740:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8a00, rc 0) 00010000:00010000:2.0:1784935553.134868:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935553.136082:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+58:11363:x1871640273151744:12345-192.168.203.28@tcp:101:bash.0 Request processed in 1673us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.136093:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 118 00000100:00100000:1.0:1784935553.146638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.147036:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273152000 00000100:00100000:3.0:1784935553.147046:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273152000 00000100:00100000:3.0:1784935553.147143:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 29 00000100:00100000:3.0:1784935553.147154:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+58:11363:x1871640273152000:12345-192.168.203.28@tcp:35:bash.0 00000100:00100000:3.0:1784935553.147386:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+59:11363:x1871640273152000:12345-192.168.203.28@tcp:35:bash.0 Request processed in 233us (757us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1784935553.147395:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 29 00000100:00100000:2.0:1784935553.258171:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.258406:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273152128 00000100:00100000:3.0:1784935553.258427:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273152128 00000100:00100000:3.0:1784935553.258610:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 119 00000100:00100000:3.0:1784935553.258620:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+59:11369:x1871640273152128:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935553.258715:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935553.258736:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16dd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa97 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.258797:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16ddc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.258812:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.258823:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935553.258888:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784935553.258892:0:7797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935553.258911:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.259131:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16dd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa97 expref: 61 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.259151:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16ddc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa97 expref: 60 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.259569:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:3.0:1784935553.259572:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784935553.259576:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020000, rc 0) 00000100:00100000:3.0:1784935553.259762:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11369:x1871640273152128:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 1142us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935553.259771:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 119 00000100:00100000:1.0:1784935553.267826:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.267911:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273152256 00000100:00100000:3.0:1784935553.267921:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273152256 00000100:00100000:3.0:1784935553.268254:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 120 00000100:00100000:3.0:1784935553.268265:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11369:x1871640273152256:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935553.268629:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935553.268659:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16de3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aa9e expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.268736:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16dea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.268767:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16dea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.268778:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16dea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.268794:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16df1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.268805:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.268812:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.268883:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b16df8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.268892:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b16df8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.268899:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b16df8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935553.268977:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784935553.268982:0:12375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935553.269000:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b16df8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269018:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b16df8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269035:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16dea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269041:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16dea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269046:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16dea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269052:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935553.269055:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16dea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269061:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16dea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269071:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:3.0:1784935553.269073:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935553.269077:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16dea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269082:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16dea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269095:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269100:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16df1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269106:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16df1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269115:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935553.269119:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16df1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269124:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16df1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269131:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d4442a6b200) 00010000:00010000:3.0:1784935553.269133:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935553.269136:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16df1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269141:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16df1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269171:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16de3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa9e expref: 62 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269189:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b16df8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa9e expref: 61 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.269195:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:3.0:1784935553.269198:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784935553.269200:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021800, rc 0) 00000100:00100000:3.0:1784935553.269260:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11369:x1871640273152256:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 997us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935553.269277:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 120 00000100:00100000:1.0:1784935553.272174:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.272277:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273152384 00000100:00100000:0.0:1784935553.272287:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273152384 00000100:00100000:0.0:1784935553.272361:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 9 00000100:00100000:0.0:1784935553.272371:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+61:2391:x1871640273152384:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935553.272385:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935553.272406:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b16df8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa9e expref: 61 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.272425:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935553.272430:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935553.272482:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+60:2391:x1871640273152384:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 113us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.272490:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 9 00000100:00100000:2.0:1784935553.274688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.274754:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273152640 00000100:00100000:0.0:1784935553.274764:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273152640 00000100:00100000:0.0:1784935553.274820:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 121 00000100:00100000:0.0:1784935553.274829:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11369:x1871640273152640:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935553.274859:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935553.274878:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16dff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aaa5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.275019:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.275034:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa90 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.275042:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.275087:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa90 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.275100:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa90 expref: 61 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935553.275112:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292094720:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935553.275207:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4541254600 going to sleep for 11 seconds 00000100:00100000:1.0:1784935553.282470:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935553.283313:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273152768 00000100:00100000:2.0:1784935553.283323:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273152768 00010000:00010000:2.0:1784935553.283366:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa90 expref: 62 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.283405:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 70 00000100:00100000:2.0:1784935553.283416:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+62:2391:x1871640273152768:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935553.283429:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935553.283436:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa90 expref: 62 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.283450:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa90 expref: 62 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.283471:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:2.0:1784935553.283477:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.283488:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.283495:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.283529:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935553.283584:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+62:2391:x1871640273152768:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 170us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935553.283592:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 70 00010000:00010000:0.0:1784935553.283878:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16dce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa90 expref: 61 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935553.283894:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292094720:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935553.283913:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.283964:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.283971:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935553.283987:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784935553.284102:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16dff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaa5 expref: 62 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.284119:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaa5 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.284126:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935553.284129:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784935553.284131:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698e00, rc 0) 00000100:00100000:0.0:1784935553.284181:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11369:x1871640273152640:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 9354us (9501us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1784935553.284189:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 121 00000100:00100000:1.0:1784935553.292052:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.292320:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273153024 00000100:00100000:0.0:1784935553.292331:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273153024 00000100:00100000:0.0:1784935553.292395:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00100000:0.0:1784935553.292405:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11369:x1871640273153024:12345-192.168.203.28@tcp:103:lfs.0 00010000:00010000:0.0:1784935553.292419:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935553.292443:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16d57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa74 expref: 61 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.292480:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935553.292484:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935553.292543:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11369:x1871640273153024:12345-192.168.203.28@tcp:103:lfs.0 Request processed in 138us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.292550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00100000:1.0:1784935553.294833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.297519:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273153152 00000100:00100000:3.0:1784935553.297549:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273153152 00000100:00100000:3.0:1784935553.297737:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 122 00000100:00100000:3.0:1784935553.297749:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11369:x1871640273153152:12345-192.168.203.28@tcp:58:lfs.0 00010000:00010000:3.0:1784935553.297843:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.297858:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.297869:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784935553.297983:0:7797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1784935553.298068:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11369:x1871640273153152:12345-192.168.203.28@tcp:58:lfs.0 Request processed in 322us (3244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935553.298076:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 122 00000100:00100000:2.0:1784935553.302137:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.302383:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273153280 00000100:00100000:3.0:1784935553.302392:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273153280 00000100:00100000:3.0:1784935553.302451:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 123 00000100:00100000:3.0:1784935553.302461:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+60:11369:x1871640273153280:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935553.302480:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935553.302498:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16e1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aaac expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.302572:0:12375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.302583:0:12375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16e1b lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaac expref: 61 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.302613:0:12375:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.302628:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16e1b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaac expref: 61 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.302642:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:3.0:1784935553.302646:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784935553.302649:0:12375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16e1b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaac expref: 61 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.302657:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020200, rc 0) 00000100:00100000:3.0:1784935553.302719:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11369:x1871640273153280:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 258us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935553.302726:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 123 00000040:00080000:0.0:1784935553.325261:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935553.325282:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784935553.325331:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1784935553.325342:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784935553.325483:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292094848:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784935553.325628:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4541254cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935553.341532:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292094848:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784935553.342057:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.342123:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273153408 00000100:00100000:0.0:1784935553.342130:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273153408 00000100:00100000:0.0:1784935553.342196:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 124 00000100:00100000:0.0:1784935553.342205:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11370:x1871640273153408:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784935553.342235:0:6525:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784935553.342353:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11370:x1871640273153408:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 149us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.342360:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 124 00000100:00100000:2.0:1784935553.353385:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.353525:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273153536 00000100:00100000:0.0:1784935553.353535:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273153536 00000100:00100000:0.0:1784935553.353590:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 125 00000100:00100000:0.0:1784935553.353599:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11370:x1871640273153536:12345-192.168.203.28@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784935553.353680:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16e22 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353696:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16e22 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353708:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16e22 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353721:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16e29 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353727:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16e29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353732:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16e29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353751:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353759:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353764:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935553.353802:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784935553.353805:0:7797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935553.353815:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353824:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16e22 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353838:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16e22 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353844:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16e22 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353849:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935553.353853:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16e22 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353859:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16e22 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353869:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:0.0:1784935553.353872:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935553.353876:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16e22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353881:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b16e22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353894:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16e29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353900:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16e29 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353905:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16e29 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353910:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935553.353918:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16e29 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.353923:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16e29 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.354182:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8d45705a8600) 00010000:00010000:0.0:1784935553.354185:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935553.354188:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16e29 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.354194:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b16e29 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.354209:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.354214:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.354219:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.354223:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935553.354226:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.354232:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.354238:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935553.354240:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935553.354250:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.354255:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935553.358534:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11370:x1871640273153536:12345-192.168.203.28@tcp:34:lhsmtool_posix.0 Request processed in 4924us (5147us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.358551:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 125 00000100:00100000:1.0:1784935553.367639:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.367714:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273153792 00000100:00100000:0.0:1784935553.367724:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273153792 00000100:00100000:0.0:1784935553.367782:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 126 00000100:00100000:0.0:1784935553.367792:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+61:11370:x1871640273153792:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784935553.367810:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935553.367829:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b16e37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aab3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368072:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368088:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368099:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935553.368111:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784935553.368190:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368197:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368203:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368228:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935553.368233:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368240:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368251:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935553.368254:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784935553.368260:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368390:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368438:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b16e37 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aab3 expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368448:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:0.0:1784935553.368450:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784935553.368454:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b16e37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aab3 expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.368463:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699200, rc 0) 00000100:00100000:0.0:1784935553.368527:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+62:11370:x1871640273153792:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 736us (896us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1784935553.368534:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 126 00000100:00100000:2.0:1784935553.373435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935553.373549:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273153920 00000100:00100000:1.0:1784935553.373559:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273153920 00000100:00100000:1.0:1784935553.373610:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 127 00000100:00100000:1.0:1784935553.373618:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+62:11370:x1871640273153920:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784935553.373657:0:6526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784935553.373757:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+62:11370:x1871640273153920:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.373764:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 127 00000100:00100000:1.0:1784935553.378849:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.379138:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273154176 00000100:00100000:3.0:1784935553.379149:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273154176 00000100:00100000:3.0:1784935553.379335:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 128 00000100:00100000:3.0:1784935553.379346:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+62:11370:x1871640273154176:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784935553.379365:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935553.379369:0:7797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784935553.379392:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16ddc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa97 expref: 62 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.379409:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:3.0:1784935553.379414:0:7797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784935553.379439:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e4c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aaba expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784935553.379771:0:7797:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1784935553.381139:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b16e53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.381445:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b16e53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.381459:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b16e53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.381530:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e4c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaba expref: 64 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.381550:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b16e53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaba expref: 63 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.381559:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e200) 00010000:00010000:3.0:1784935553.381562:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784935553.381565:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021600, rc 0) 00000100:00100000:3.0:1784935553.381637:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+63:11370:x1871640273154176:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 2292us (2805us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1784935553.381645:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 128 00000100:00100000:2.0:1784935553.385066:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.385214:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273154432 00000100:00100000:0.0:1784935553.385236:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273154432 00000100:00100000:0.0:1784935553.385305:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 129 00000100:00100000:0.0:1784935553.385314:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+63:11370:x1871640273154432:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784935553.385367:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935553.385391:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b16e53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaba expref: 63 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385409:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e200) 00010000:00010000:0.0:1784935553.385418:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784935553.385437:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e61 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385448:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385457:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385469:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x1ecc9751 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385476:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ecc9751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385482:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ecc9751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385520:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385526:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e61 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385537:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e61 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385543:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935553.385546:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e61 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385552:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e61 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385559:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935553.385562:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935553.385565:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e61 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385570:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16e61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385578:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ecc9751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385582:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e68 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ecc9751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385587:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ecc9751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385591:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935553.385593:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ecc9751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385604:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e68 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ecc9751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385611:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x1ecc9751 (ffff8d45705a8600) 00010000:00010000:0.0:1784935553.385613:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935553.385616:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e68 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1ecc9751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.385620:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b16e68 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1ecc9751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935553.385693:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+62:11370:x1871640273154432:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 380us (636us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784935553.385699:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 129 00000100:00100000:0.0:1784935553.388471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.388536:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273154560 00000100:00100000:3.0:1784935553.388544:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273154560 00000100:00100000:3.0:1784935553.388594:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 130 00000100:00100000:3.0:1784935553.388602:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+62:11370:x1871640273154560:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784935553.388636:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935553.388656:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16e6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aac1 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.388685:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16e76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.388696:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.388705:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.388794:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16e6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac1 expref: 64 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.388809:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16e76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac1 expref: 63 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.388816:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:3.0:1784935553.388819:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784935553.388822:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020800, rc 0) 00000100:00100000:3.0:1784935553.388875:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+63:11370:x1871640273154560:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 273us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935553.388880:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 130 00000100:00100000:2.0:1784935553.395478:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.395830:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273154816 00000100:00100000:3.0:1784935553.395840:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273154816 00000100:00100000:3.0:1784935553.395906:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 131 00000100:00100000:3.0:1784935553.395917:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+63:11370:x1871640273154816:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784935553.396047:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.396064:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.396075:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784935553.396216:0:7797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:3.0:1784935553.396265:0:7797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c172d6be reply state 0000000021260150 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.396291:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.396308:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:3.0:1784935553.396311:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784935553.396314:0:7797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784935553.396417:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+65:11370:x1871640273154816:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 500us (945us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1784935553.396424:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 131 00000100:00100000:2.0:1784935553.402370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935553.402463:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273154944 00000100:00100000:1.0:1784935553.402472:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273154944 00000100:00100000:1.0:1784935553.402532:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 132 00000100:00100000:1.0:1784935553.402542:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+65:11370:x1871640273154944:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935553.402565:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935553.402584:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16e84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aac8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.402650:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16e84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac8 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.402664:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16e84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac8 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.402683:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:1.0:1784935553.402686:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784935553.402689:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9e00, rc 0) 00000100:00100000:1.0:1784935553.402757:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+66:11370:x1871640273154944:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 216us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.402764:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 132 00000100:00100000:0.0:1784935553.405613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935553.406171:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273155072 00000100:00100000:1.0:1784935553.406199:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273155072 00000100:00100000:1.0:1784935553.406288:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 45 00000100:00100000:1.0:1784935553.406309:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273155072:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784935553.406528:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2391:x1871640273155072:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 Request processed in 231us (924us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1784935553.406536:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 45 00000100:00080000:0.0:1784935553.408092:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935553.416053:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.416151:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273155328 00000100:00100000:0.0:1784935553.416162:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273155328 00000100:00100000:0.0:1784935553.416222:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 30 00000100:00100000:0.0:1784935553.416236:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+66:11370:x1871640273155328:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784935553.416485:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+67:11370:x1871640273155328:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 251us (440us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1784935553.416493:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 30 00000100:00100000:3.0:1784935553.421292:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935553.421585:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273155584 00000100:00100000:1.0:1784935553.421595:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273155584 00000100:00100000:1.0:1784935553.421667:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 133 00000100:00100000:1.0:1784935553.421677:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+67:11370:x1871640273155584:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784935553.421802:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+67:11370:x1871640273155584:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 126us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.421809:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 133 00000100:00100000:2.0:1784935553.425088:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935553.425183:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273155712 00000100:00100000:1.0:1784935553.425193:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273155712 00000100:00100000:1.0:1784935553.425288:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 134 00000100:00100000:1.0:1784935553.425306:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+67:11370:x1871640273155712:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935553.425330:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935553.425350:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16e8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aacf expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.425418:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16e92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.425433:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.425465:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935553.425511:0:7797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935553.425531:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.425555:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16e8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aacf expref: 69 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.425574:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aacf expref: 68 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.425583:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:1.0:1784935553.425586:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784935553.425589:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8a00, rc 0) 00000100:00100000:1.0:1784935553.425664:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+68:11370:x1871640273155712:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 368us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.425671:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 134 00000100:00100000:2.0:1784935553.428855:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.429587:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273155840 00000100:00100000:0.0:1784935553.429597:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273155840 00000100:00100000:0.0:1784935553.429666:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 46 00000100:00100000:0.0:1784935553.429691:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2391:x1871640273155840:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784935553.429710:0:8987:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935553.429745:0:8987:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a4fd5a5/0x857e02f4e0b16e99 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aad6 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784935553.429770:0:8987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63f481, blocks: 0x0 00010000:00010000:0.0:1784935553.429788:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1784935553.429793:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935553.429801:0:8987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4fd5a5/0x857e02f4e0b16e99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aad6 expref: 10 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.429818:0:8987:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a4fd5a5/0x857e02f4e0b16e99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aad6 expref: 10 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.429842:0:8987:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698000, rc 0) 00000100:00100000:0.0:1784935553.429905:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+10:2391:x1871640273155840:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 215us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.429912:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 46 00000100:00100000:3.0:1784935553.436483:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935553.436549:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273156096 00000100:00100000:2.0:1784935553.436559:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273156096 00000100:00100000:2.0:1784935553.436630:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 135 00000100:00100000:2.0:1784935553.436642:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+68:11370:x1871640273156096:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784935553.436772:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+68:11370:x1871640273156096:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 132us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935553.436779:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 135 00000100:00100000:1.0:1784935553.439153:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.439237:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273156224 00000100:00100000:3.0:1784935553.439248:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273156224 00000100:00100000:3.0:1784935553.439313:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 47 00000100:00100000:3.0:1784935553.439323:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+10:11370:x1871640273156224:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784935553.439340:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935553.439371:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aadd expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.439404:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a4fd5a5/0x857e02f4e0b16e99 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aad6 expref: 11 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.439413:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935553.439416:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935553.439421:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.439471:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a4fd5a5/0x857e02f4e0b16e99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aad6 expref: 11 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.439485:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a4fd5a5/0x857e02f4e0b16e99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aad6 expref: 11 pid: 8987 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935553.439497:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1871640292094976:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935553.440020:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547eab840 going to sleep for 11 seconds 00000100:00100000:2.0:1784935553.445724:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.445851:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1871640292094976:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935553.445887:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.445909:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020000, rc 0) 00000100:00100000:3.0:1784935553.446006:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+11:11370:x1871640273156224:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 6684us (6860us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935553.446034:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 47 00000100:00100000:1.0:1784935553.447006:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273156352 00000100:00100000:1.0:1784935553.447019:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273156352 00010000:00010000:1.0:1784935553.447058:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a4fd5a5/0x857e02f4e0b16e99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aad6 expref: 11 pid: 8987 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935553.447100:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 71 00000100:00100000:1.0:1784935553.447108:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+11:2392:x1871640273156352:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935553.447137:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935553.447159:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a4fd5a5/0x857e02f4e0b16e99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aad6 expref: 11 pid: 8987 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.447172:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a4fd5a5/0x857e02f4e0b16e99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aad6 expref: 11 pid: 8987 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.447193:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a4fd5a5/0x857e02f4e0b16e99 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aad6 expref: 11 pid: 8987 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.447210:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935553.447214:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935553.447221:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.447231:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.447277:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935553.447294:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6511:1871640292095104:192.168.203.28@tcp:105: 00000100:00100000:1.0:1784935553.447377:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455199fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935553.451619:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.451716:0:8444:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273156480 00000100:00100000:3.0:1784935553.451737:0:8444:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273156480 00002000:00100000:3.0:1784935553.451788:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8d4443d4f100 x1871640273156480/t0(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:49/0 lens 504/0 e 0 to 0 dl 1784935564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784935553.451800:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443d4f100 with x1871640273156480 ext(0->12) 00002000:00010000:3.0:1784935553.451806:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443d4f100 00000100:00100000:1.0:1784935553.451806:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6511:1871640292095104:192.168.203.28@tcp:105: 00010000:00010000:1.0:1784935553.451830:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935553.451855:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 2 00000100:00100000:3.0:1784935553.451867:0:8444:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+11:2391:x1871640273156480:12345-192.168.203.28@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1784935553.451902:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+11:2392:x1871640273156352:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 4793us (6186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.451912:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 71 00000100:00100000:2.0:1784935553.455744:0:8444:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+12:2391:x1871640273156480:12345-192.168.203.28@tcp:4:lhsmtool_posix.0 Request processed in 3866us (4121us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784935553.455779:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 2 00002000:00100000:2.0:1784935553.455795:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8d4443d4f100 x1871640273156480/t4294967309(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:49/0 lens 504/448 e 0 to 0 dl 1784935564 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784935553.455807:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443d4f100 with x1871640273156480 ext(0->12) 00002000:00010000:2.0:1784935553.455815:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443d4f100 00000100:00100000:2.0:1784935553.463206:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.463730:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273156608 00000100:00100000:0.0:1784935553.463741:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273156608 00000100:00100000:0.0:1784935553.463804:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 136 00000100:00100000:0.0:1784935553.463815:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+68:11370:x1871640273156608:12345-192.168.203.28@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784935553.478665:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1784935553.478746:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:1.0:1784935553.478914:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.478953:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.478973:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.478980:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935553.478985:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479000:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479016:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d457d166900) 00010000:00010000:1.0:1784935553.479019:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935553.479023:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479037:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ba5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479076:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479095:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479129:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479135:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935553.479138:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479145:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479160:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d4442a6b500) 00010000:00010000:1.0:1784935553.479162:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935553.479165:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479171:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16c4d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479195:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479202:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479208:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479212:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935553.479215:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479242:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479257:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d4442a6b200) 00010000:00010000:1.0:1784935553.479260:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935553.479263:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479269:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16ccb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479279:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479292:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479307:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479330:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935553.479334:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479340:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479347:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d4442a6b200) 00010000:00010000:1.0:1784935553.479350:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935553.479352:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479376:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b16cee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479402:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479409:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479414:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479418:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935553.479422:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479427:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479446:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:1.0:1784935553.479449:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935553.479452:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479458:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16dc0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479478:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479485:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479505:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479511:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935553.479514:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479520:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479528:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:1.0:1784935553.479530:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784935553.479544:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.479551:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b16e7d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935553.483147:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935553.483176:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292095232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784935553.483274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935553.484092:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292095232 00000100:00100000:3.0:1784935553.484101:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292095232 00000020:00080000:2.0:1784935553.484117:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d454831e600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1784935553.484124:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d444281e200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d454831e480 00000020:00080000:2.0:1784935553.484128:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d444281ea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d444304c000 00000004:00080000:2.0:1784935553.484164:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:3.0:1784935553.484185:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784935553.484198:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3649:x1871640292095232:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1784935553.484203:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d444236a540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1784935553.484208:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d44435c4300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d444236ae40 00000020:00080000:2.0:1784935553.484211:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d44435c4500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d444363fe00 00000020:00080000:2.0:1784935553.484224:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00002000:00080000:3.0:1784935553.484235:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00000020:00080000:2.0:1784935553.484243:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00002000:00010000:3.0:1784935553.484291:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a63f480, atime: 0x6a63f480, ctime: 0x6a63f480, blocks: 0x8 00010000:00010000:3.0:1784935553.484489:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000680a1a38/0x857e02f4e0b16ea7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784935553.484502:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1784935553.484516:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1784935553.484521:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935553.484534:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000680a1a38/0x857e02f4e0b16ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.484548:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000680a1a38/0x857e02f4e0b16ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.484581:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000680a1a38/0x857e02f4e0b16ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.484589:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000680a1a38/0x857e02f4e0b16ea7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.484621:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784935553.484807:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3649:x1871640292095232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 612us (1540us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1784935553.484816:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1784935553.485355:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935553.485465:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+16:11370:x1871640273156608:12345-192.168.203.28@tcp:44:lhsmtool_posix.0 Request processed in 21649us (22265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.485474:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 136 00000100:00100000:1.0:1784935553.485742:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935553.485758:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292095360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784935553.485801:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1784935553.485866:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d4443d2ed80/2, rc 0, transno 4294967305 00000100:00100000:1.0:1784935553.485873:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292095232:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1784935553.486237:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935553.486246:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000680a1a38/0x857e02f4e0b16ea7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.486278:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021800 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935553.486283:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000680a1a38/0x857e02f4e0b16ea7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.486437:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000680a1a38/0x857e02f4e0b16ea7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.486460:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000680a1a38/0x857e02f4e0b16ea7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.486469:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000680a1a38/0x857e02f4e0b16ea7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.486492:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935553.486494:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935553.486496:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935553.486966:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292095360 00000100:00100000:0.0:1784935553.486975:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292095360 00000100:00100000:0.0:1784935553.487041:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784935553.487059:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640292095360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784935553.487088:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1784935553.487110:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.487128:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d554100f/0x857e02f4e0b16c5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa35 expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.487137:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1784935553.487141:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784935553.487146:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.487212:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d554100f/0x857e02f4e0b16c5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa35 expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.487236:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d554100f/0x857e02f4e0b16c5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa35 expref: 11 pid: 8440 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935553.487252:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1871640292095488:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935553.487601:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4541254600 going to sleep for 11 seconds 00000100:00080000:1.0:1784935553.488208:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935553.488638:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.488710:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273156736 00000100:00100000:3.0:1784935553.488717:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273156736 00000100:00100000:3.0:1784935553.488807:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:3.0:1784935553.488817:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+12:2394:x1871640273156736:12345-192.168.203.28@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784935553.490222:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1871640292095488:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935553.490256:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.490489:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.490574:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273156864 00000100:00100000:0.0:1784935553.490580:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273156864 00010000:00010000:0.0:1784935553.490616:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d554100f/0x857e02f4e0b16c5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa35 expref: 13 pid: 8440 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935553.490679:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 72 00000100:00100000:0.0:1784935553.490694:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45729c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+13:2392:x1871640273156864:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935553.490709:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935553.490715:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d554100f/0x857e02f4e0b16c5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa35 expref: 13 pid: 8440 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.490741:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d554100f/0x857e02f4e0b16c5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa35 expref: 13 pid: 8440 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.490781:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d554100f/0x857e02f4e0b16c5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa35 expref: 13 pid: 8440 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.490797:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784935553.490809:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784935553.490815:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.490824:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.490867:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935553.490989:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45729c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+12:2392:x1871640273156864:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 301us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.490997:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 72 00010000:00010000:2.0:1784935553.491633:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.491645:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.491663:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.491670:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.491708:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784935553.491917:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1871640292095360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4868us (6114us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784935553.491947:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1784935553.491970:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935553.491975:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.491996:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935553.492001:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.492009:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.492024:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.492031:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f340646/0x857e02f4e0b16eae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.492059:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935553.492061:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935553.492062:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784935553.493412:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d4443cd4000/2, rc 0, transno 4294967310 00000100:00100000:2.0:1784935553.493433:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292095360:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1784935553.496413:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1784935553.496439:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1784935553.496613:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273156736:12345-192.168.203.28@tcp:16:lhsmtool_posix.0 Request processed in 7792us (7973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935553.496626:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:2.0:1784935553.498414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935553.498707:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273157120 00000100:00100000:1.0:1784935553.498731:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273157120 00000100:00100000:1.0:1784935553.498792:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 137 00000100:00100000:1.0:1784935553.498801:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+16:11370:x1871640273157120:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784935553.498855:0:7797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935553.498880:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16e92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aacf expref: 16 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.498898:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:1.0:1784935553.498903:0:7797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935553.498967:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.498981:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.498992:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784935553.499218:0:7797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004585cc67 reply state 0000000044737410 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.499230:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.499237:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:1.0:1784935553.499240:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784935553.499243:0:7797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784935553.499398:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+17:11370:x1871640273157120:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 596us (989us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1784935553.499406:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 137 00000100:00100000:2.0:1784935553.505869:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.506304:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273157248 00000100:00100000:3.0:1784935553.506314:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273157248 00000100:00100000:3.0:1784935553.506413:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00100000:3.0:1784935553.506423:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273157248:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784935553.506558:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1784935553.506561:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784935553 00002000:00010000:3.0:1784935553.506563:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784935552 00002000:00010000:3.0:1784935553.506588:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1784935553 -> 1784935553 00002000:00010000:3.0:1784935553.506590:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1784935553.506649:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273157248:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 Request processed in 227us (789us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1784935553.506657:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00100000:3.0:1784935553.513203:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935553.514367:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273157504 00000100:00100000:1.0:1784935553.514379:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273157504 00000100:00100000:1.0:1784935553.514507:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 138 00000100:00100000:1.0:1784935553.514518:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+17:11370:x1871640273157504:12345-192.168.203.28@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1784935553.514585:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.514602:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16e76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac1 expref: 17 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.514611:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.514645:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16e76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac1 expref: 17 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.514658:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16e76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac1 expref: 17 pid: 12375 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935553.514673:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292095616:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935553.514766:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4540024840 going to sleep for 11 seconds 00000100:00100000:1.0:1784935553.517999:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292095616:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935553.518027:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935553.518981:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.519179:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273157632 00000100:00100000:0.0:1784935553.519187:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273157632 00010000:00010000:0.0:1784935553.519224:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16e76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac1 expref: 18 pid: 12375 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935553.519267:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 73 00000100:00100000:0.0:1784935553.519277:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+18:2391:x1871640273157632:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935553.519292:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935553.519314:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16e76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac1 expref: 18 pid: 12375 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.519327:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16e76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac1 expref: 18 pid: 12375 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.519349:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b16e76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac1 expref: 18 pid: 12375 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.519364:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:0.0:1784935553.519369:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.519390:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.519398:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.519431:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935553.519484:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+17:2391:x1871640273157632:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 209us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.519491:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 73 00010000:00010000:2.0:1784935553.519839:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.519960:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.519995:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.520003:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.520010:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.520016:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935553.520020:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.520027:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.520037:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:2.0:1784935553.520040:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784935553.520044:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.520050:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b16ebc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.520113:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+16:11370:x1871640273157504:12345-192.168.203.28@tcp:55:lhsmtool_posix.0 Request processed in 5596us (6916us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784935553.520124:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 138 00000100:00100000:3.0:1784935553.527531:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935553.528031:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273157760 00000100:00100000:2.0:1784935553.528042:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273157760 00000100:00100000:2.0:1784935553.528095:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 52 00000100:00100000:2.0:1784935553.528105:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2393:x1871640273157760:12345-192.168.203.28@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784935553.528148:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.528169:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.528179:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935553.528184:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784935553.528188:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.528222:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.528237:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 7 pid: 8440 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.528253:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1871640292095744:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935553.530424:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935553.540037:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.540170:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273157888 00000100:00100000:3.0:1784935553.540180:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273157888 00010000:00010000:3.0:1784935553.540217:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 8 pid: 8440 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.540351:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1871640292095744:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935553.540373:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935553.540432:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 74 00000100:00100000:3.0:1784935553.540443:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273157888:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935553.540457:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935553.540478:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 8 pid: 8440 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.540490:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 8 pid: 8440 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.540512:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025429caf/0x857e02f4e0b16ea0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aadd expref: 8 pid: 8440 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.540528:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784935553.540547:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784935553.540553:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.540563:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.540605:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935553.540660:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273157888:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 219us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935553.540668:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 74 00010000:00010000:2.0:1784935553.541097:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.541107:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.541127:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.541135:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.541143:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.541150:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935553.541154:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.541162:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.541188:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.541196:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0c4517b/0x857e02f4e0b16ec3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.541262:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2393:x1871640273157760:12345-192.168.203.28@tcp:1:lhsmtool_posix.0 Request processed in 13158us (13740us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935553.541271:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 52 00000100:00100000:0.0:1784935553.544797:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935553.544877:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273158144 00000100:00100000:2.0:1784935553.544887:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273158144 00000100:00100000:2.0:1784935553.544965:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 139 00000100:00100000:2.0:1784935553.544975:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+16:11370:x1871640273158144:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784935553.545047:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.545064:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16db9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa89 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.545073:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.545103:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16db9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa89 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.545115:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16db9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa89 expref: 16 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.545141:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292095872:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935553.545270:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935553.551833:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.552373:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273158272 00000100:00100000:0.0:1784935553.552383:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273158272 00010000:00010000:0.0:1784935553.552421:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16db9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa89 expref: 17 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935553.552463:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 75 00000100:00100000:0.0:1784935553.552472:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+17:2392:x1871640273158272:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935553.552486:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935553.552493:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16db9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa89 expref: 17 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.552506:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16db9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa89 expref: 17 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.552526:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935553.552545:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16e1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaac expref: 17 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.552556:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.552564:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.552571:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.552588:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935553.552639:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+17:2392:x1871640273158272:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 168us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.552647:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 75 00010000:00010000:2.0:1784935553.553681:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16db9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa89 expref: 16 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.553698:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292095872:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935553.553717:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.553725:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.553731:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.554091:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.554105:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16e84 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac8 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.554113:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.554144:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16e84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac8 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.554160:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16e84 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac8 expref: 16 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.554188:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292096000:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935553.554320:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2840 going to sleep for 11 seconds 00000100:00100000:1.0:1784935553.559453:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935553.559518:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292096000:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935553.559533:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273158400 00000100:00100000:0.0:1784935553.559542:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273158400 00010000:00010000:2.0:1784935553.559557:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.559581:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16e84 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac8 expref: 17 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935553.559621:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 76 00000100:00100000:0.0:1784935553.559630:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+17:2391:x1871640273158400:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935553.559644:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935553.559650:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16e84 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac8 expref: 17 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.559661:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16e84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac8 expref: 17 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.559697:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b16e84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aac8 expref: 17 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.559710:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:0.0:1784935553.559714:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.559723:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.559729:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935553.559758:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935553.559835:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.559844:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935553.560002:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+16:2391:x1871640273158400:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 372us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.560011:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 76 00000001:00080000:2.0:1784935553.560066:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1784935553.560182:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1784935553.560218:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1784935553.560530:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1871640292096128:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784935553.561119:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935553.561147:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784935553.563232:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292096128 00000100:00100000:0.0:1784935553.563245:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292096128 00000100:00100000:0.0:1784935553.563311:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784935553.563320:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6527:x1871640292096128:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784935553.563431:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6527:x1871640292096128:12345-0@lo:1000:mdt00_002.0 Request processed in 113us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.563438:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784935553.563492:0:6527:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1784935553.563499:0:6527:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1784935553.563521:0:6527:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d4443cd4000 x1871640292095360/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784935569 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935553.563531:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1871640292096128:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1784935553.563676:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1784935553.563745:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1871640292096256:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784935553.563782:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935553.564002:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2000 going to sleep for 11 seconds 00000100:00100000:3.0:1784935553.566721:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292096256 00000100:00100000:3.0:1784935553.566735:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292096256 00000100:00100000:0.0:1784935553.567029:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784935553.567042:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6527:x1871640292096256:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784935553.567249:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6527:x1871640292096256:12345-0@lo:1000:mdt00_002.0 Request processed in 209us (3465us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1784935553.567272:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784935553.567384:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1871640292096256:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1784935553.567434:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567445:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567454:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567460:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935553.567464:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567472:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567487:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:2.0:1784935553.567490:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784935553.567495:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567501:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ed1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567524:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567530:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567609:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567622:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935553.567625:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567632:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567641:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:2.0:1784935553.567644:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784935553.567650:0:6527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16e1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaac expref: 19 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567660:0:6527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16e1b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaac expref: 19 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567671:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16e1b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaac expref: 19 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.567703:0:6527:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16e1b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaac expref: 19 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.567716:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292096384:192.168.203.28@tcp:105: 00000100:00100000:2.0:1784935553.567787:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1efa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784935553.571769:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935553.571942:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273158528 00000100:00100000:0.0:1784935553.571960:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273158528 00000100:00100000:0.0:1784935553.572017:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 31 00000100:00100000:0.0:1784935553.572028:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+20:11369:x1871640273158528:12345-192.168.203.28@tcp:49:lfs.0 00000100:00100000:2.0:1784935553.572136:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292096384:192.168.203.28@tcp:105: 00000100:00100000:0.0:1784935553.572153:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+20:11369:x1871640273158528:12345-192.168.203.28@tcp:49:lfs.0 Request processed in 126us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.572161:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 31 00010000:00010000:2.0:1784935553.572163:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572186:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b16e14 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572216:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16ed8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572229:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572241:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572251:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572258:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16ed8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572612:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16ed8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572621:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935553.572625:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16ed8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572632:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16ed8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572644:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:2.0:1784935553.572647:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935553.572650:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16ed8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572663:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16ed8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572675:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572681:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572686:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572690:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935553.572693:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572699:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572708:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:2.0:1784935553.572710:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784935553.572714:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.572719:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16eca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.573413:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+19:11370:x1871640273158144:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 28434us (28620us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1784935553.573425:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 139 00000020:00080000:2.0:1784935553.573439:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784935553.573500:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935553.573506:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784935553.574009:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1784935553.574021:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784935553.578526:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.578615:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273158784 00000100:00100000:3.0:1784935553.578626:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273158784 00000100:00100000:3.0:1784935553.578681:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 32 00000100:00100000:3.0:1784935553.578691:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+19:11370:x1871640273158784:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784935553.579125:0:6528:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784935553.579161:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1784935553.579194:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16edf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.579210:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16edf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.579221:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16edf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.579230:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16edf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.579249:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16edf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.579256:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16edf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935553.579390:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784935553.579488:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935553.579497:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16edf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.579505:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935553.579509:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16edf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.579517:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16edf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.579529:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:2.0:1784935553.579533:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784935553.579548:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16edf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.579554:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b16edf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.579568:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935553.579570:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935553.579572:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935553.582705:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935553.582764:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273159040 00000100:00100000:2.0:1784935553.582774:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273159040 00000100:00100000:2.0:1784935553.582845:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 140 00000100:00100000:2.0:1784935553.582856:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+22:11369:x1871640273159040:12345-192.168.203.28@tcp:58:lfs.0 00000040:00080000:2.0:1784935553.583044:0:7797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1784935553.583119:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+22:11369:x1871640273159040:12345-192.168.203.28@tcp:58:lfs.0 Request processed in 265us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935553.583127:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 140 00000100:00100000:0.0:1784935553.584040:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+21:11370:x1871640273158784:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 5345us (5585us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1784935553.584051:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 32 00000020:00080000:0.0:1784935553.584056:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784935553.633984:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935553.634353:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273159168 00000100:00100000:2.0:1784935553.634373:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273159168 00000100:00100000:2.0:1784935553.634438:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 141 00000100:00100000:2.0:1784935553.634448:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+21:11372:x1871640273159168:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935553.634472:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935553.634492:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16ee6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aae4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.634577:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16eed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.634592:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16eed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.634603:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16eed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.634617:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ef4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.634624:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.634630:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.634704:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.634715:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaa5 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.634737:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.634771:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaa5 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.634786:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaa5 expref: 22 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.634800:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292096512:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935553.634914:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2000 going to sleep for 11 seconds 00000100:00100000:0.0:1784935553.638218:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935553.638356:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273159424 00000100:00100000:3.0:1784935553.638365:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273159424 00000100:00100000:3.0:1784935553.638420:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 33 00000100:00100000:3.0:1784935553.638431:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+23:6160:x1871640273159424:12345-192.168.203.28@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784935553.638653:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+24:6160:x1871640273159424:12345-192.168.203.28@tcp:35:ldlm_bl.0 Request processed in 223us (442us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1784935553.638660:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 33 00000100:00100000:2.0:1784935553.640013:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292096512:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935553.640039:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935553.643409:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935553.643525:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273159552 00000100:00100000:2.0:1784935553.643535:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273159552 00010000:00010000:2.0:1784935553.643574:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaa5 expref: 24 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935553.643619:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 77 00000100:00100000:2.0:1784935553.643629:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+24:2392:x1871640273159552:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935553.643644:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935553.643651:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaa5 expref: 24 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.643678:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaa5 expref: 24 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.643700:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b16e06 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaa5 expref: 24 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.643717:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:2.0:1784935553.643722:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.643730:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.643737:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935553.643770:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935553.643836:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+23:2392:x1871640273159552:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 207us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935553.643843:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 77 00010000:00010000:1.0:1784935553.644591:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644602:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935553.644646:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784935553.644650:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935553.644669:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644681:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644690:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16eed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644696:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16eed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644703:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16eed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644708:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935553.644712:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16eed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644720:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16eed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644742:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:1.0:1784935553.644744:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935553.644749:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16eed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644755:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b16eed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644768:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644773:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644778:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644783:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935553.644785:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644790:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644796:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d4442a6bc00) 00010000:00010000:1.0:1784935553.644799:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935553.644801:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ef4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644806:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b16ef4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644863:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16ee6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aae4 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644875:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aae4 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935553.644881:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:1.0:1784935553.644883:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935553.644885:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201200, rc 0) 00000100:00100000:1.0:1784935553.645120:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+22:11372:x1871640273159168:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 10481us (10953us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.645127:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 141 00000100:00100000:3.0:1784935553.965156:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292096640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935553.965260:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935553.966191:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935553.966209:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292096768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784935553.966257:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935553.966307:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292096640 00000100:00100000:2.0:1784935553.966314:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292096640 00000100:00100000:2.0:1784935553.966361:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292096768 00000100:00100000:2.0:1784935553.966364:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292096768 00000100:00100000:2.0:1784935553.966379:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784935553.966395:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292096640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784935553.966418:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935553.966466:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292096640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935553.966473:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784935553.966488:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784935553.966494:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3650:x1871640292096768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784935553.966503:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935553.966527:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3650:x1871640292096768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935553.966532:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1784935553.966546:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784935553.966581:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292096768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784935553.966616:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292096640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935553.967787:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292097280:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.967836:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935553.967883:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292097792:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.967907:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935553.967950:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784935553.967957:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292096896:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.967985:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935553.968018:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292097408:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968056:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935553.968076:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292097920:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968119:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935553.968150:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292097792 00000100:00100000:0.0:1784935553.968156:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292097792 00000100:00100000:0.0:1784935553.968214:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292097920 00000100:00100000:0.0:1784935553.968217:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292097920 00000100:00100000:0.0:1784935553.968235:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784935553.968241:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292097792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968285:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292097792:12345-0@lo:400:kworker.0 Request processed in 44us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.968308:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784935553.968327:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784935553.968333:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1871640292097920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935553.968349:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292096896 00000100:00100000:1.0:1784935553.968355:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292096896 00000100:00100000:1.0:1784935553.968395:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1784935553.968405:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292096896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935553.968454:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292096896:12345-0@lo:400:kworker.0 Request processed in 51us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.968462:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1784935553.968524:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1871640292097920:12345-0@lo:400:kworker.0 Request processed in 190us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.968530:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784935553.968563:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292097408 00000100:00100000:0.0:1784935553.968567:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292097408 00000100:00100000:0.0:1784935553.968593:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784935553.968599:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292097408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968630:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292097408:12345-0@lo:400:kworker.0 Request processed in 31us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.968635:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784935553.968665:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292096896:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968689:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292097408:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968698:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292097920:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968710:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292097792:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968755:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292097024:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968781:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935553.968801:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292097536:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968823:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935553.968845:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292098048:0@lo:400:kworker.0 00000100:00100000:1.0:1784935553.968861:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292097280 00000100:00100000:0.0:1784935553.968867:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935553.968868:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292097280 00000100:00100000:0.0:1784935553.968890:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784935553.968896:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292097152:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968915:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935553.968952:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292097664:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.968972:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935553.968988:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292098176:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.969007:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935553.969026:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292097152 00000100:00100000:0.0:1784935553.969029:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292097152 00000100:00100000:0.0:1784935553.969052:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784935553.969058:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292097152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.969092:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292097152:12345-0@lo:400:kworker.0 Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.969098:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784935553.969134:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292097152:0@lo:400:kworker.0 00000100:00100000:1.0:1784935553.969150:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292097024 00000100:00100000:1.0:1784935553.969156:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292097024 00000100:00100000:0.0:1784935553.969166:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292097536 00000100:00100000:0.0:1784935553.969171:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292097536 00000100:00100000:1.0:1784935553.969175:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292098048 00000100:00100000:1.0:1784935553.969180:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292098048 00000100:00100000:0.0:1784935553.969196:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292097664 00000100:00100000:0.0:1784935553.969201:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292097664 00000100:00100000:1.0:1784935553.969207:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292098176 00000100:00100000:1.0:1784935553.969212:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292098176 00000100:00100000:0.0:1784935553.969222:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784935553.969231:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292097280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935553.969248:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784935553.969259:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292097024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.969271:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292097280:12345-0@lo:400:kworker.0 Request processed in 41us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935553.969278:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784935553.969306:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784935553.969316:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292097536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935553.969325:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292097024:12345-0@lo:400:kworker.0 Request processed in 67us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.969333:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784935553.969352:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784935553.969356:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292097536:12345-0@lo:400:kworker.0 Request processed in 42us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.969363:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292098048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.969368:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784935553.969388:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784935553.969397:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292097664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935553.969407:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292098048:12345-0@lo:400:kworker.0 Request processed in 48us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.969414:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784935553.969431:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1784935553.969436:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292097664:12345-0@lo:400:kworker.0 Request processed in 40us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.969442:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292098176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.969449:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784935553.969481:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292097280:0@lo:400:kworker.0 00000100:00100000:1.0:1784935553.969487:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292098176:12345-0@lo:400:kworker.0 Request processed in 47us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935553.969495:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00010000:00080000:0.0:1784935553.969522:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443cd7100 x1871640292097664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935553.969532:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292097664:0@lo:400:kworker.0 00010000:00080000:0.0:1784935553.969541:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443cd5180 x1871640292098176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935553.969556:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292098176:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.969568:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292097024:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.969576:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292097536:0@lo:400:kworker.0 00000100:00100000:0.0:1784935553.969585:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292098048:0@lo:400:kworker.0 00000100:00080000:2.0:1784935553.970742:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784935553.970749:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784935553.970752:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784935554.157072:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784935554.288808:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1784935554.288829:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:0.0:1784935554.397895:0:14263:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935554.397905:0:14263:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784935554.398569:0:14263:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784935554.398577:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:2.0:1784935554.477084:0:8985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373727154036ns, next at 374727151546ns, rc = 0 00000100:00100000:2.0:1784935554.477130:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292098304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935554.477210:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935554.477354:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292098304 00000100:00100000:1.0:1784935554.477362:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292098304 00000100:00100000:1.0:1784935554.477418:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784935554.477428:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1871640292098304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784935554.477451:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1784935554.477510:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1871640292098304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935554.477516:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784935554.477576:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292098304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935554.478679:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292098432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935554.478738:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935554.478834:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292098432 00000100:00100000:3.0:1784935554.478841:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292098432 00000100:00100000:3.0:1784935554.478892:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784935554.478901:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292098432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784935554.478921:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1784935554.478986:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292098432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935554.478992:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784935554.479030:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292098432:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1784935554.605144:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935554.605155:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784935554.605180:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784935554.605191:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784935554.605343:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d0b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292098560:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784935554.605450:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70840 going to sleep for 11 seconds 00000100:00100000:0.0:1784935554.608909:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d0b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292098560:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784935554.609192:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935554.614436:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273159680 00000100:00100000:0.0:1784935554.614451:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273159680 00000100:00100000:0.0:1784935554.614552:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 142 00000100:00100000:0.0:1784935554.614563:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+22:11384:x1871640273159680:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784935554.614599:0:6525:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784935554.614717:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+22:11384:x1871640273159680:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 156us (5527us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935554.614738:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 142 00000100:00080000:2.0:1784935554.614822:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935554.627754:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935554.633443:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273159936 00000100:00100000:0.0:1784935554.633458:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273159936 00000100:00100000:3.0:1784935554.633859:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 143 00000100:00100000:3.0:1784935554.633869:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+22:11384:x1871640273159936:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784935554.633889:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935554.633910:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aaeb expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935554.634072:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935554.634088:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935554.634100:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935554.634111:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784935554.634221:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaeb expref: 25 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935554.634241:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaeb expref: 24 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935554.634250:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:3.0:1784935554.634253:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784935554.634256:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021a00, rc 0) 00000100:00100000:3.0:1784935554.634431:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+24:11384:x1871640273159936:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 562us (6687us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1784935554.634439:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 143 00000100:00100000:1.0:1784935554.642265:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935554.642311:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935554.642386:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273160064 00000100:00100000:0.0:1784935554.642395:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273160064 00000100:00100000:0.0:1784935554.642462:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00100000:0.0:1784935554.642472:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+24:2392:x1871640273160064:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935554.642487:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935554.642510:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaeb expref: 24 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935554.642529:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935554.642535:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935554.642584:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+23:2392:x1871640273160064:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 113us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935554.642591:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00100000:2.0:1784935554.644028:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273160320 00000100:00100000:2.0:1784935554.644099:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273160320 00000100:00100000:2.0:1784935554.644189:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 144 00000100:00100000:2.0:1784935554.644200:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+23:11384:x1871640273160320:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784935554.644301:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935554.644317:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935554.644328:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935554.644481:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935554.644490:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f17 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935554.644496:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f17 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935554.644503:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935554.644506:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f17 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935554.644514:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f17 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935554.644525:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:2.0:1784935554.644528:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784935554.644532:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f17 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935554.644538:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f17 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935554.644734:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+24:11384:x1871640273160320:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 535us (2421us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1784935554.644741:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 144 00000040:00080000:1.0:1784935554.647282:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784935554.647301:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784935554.648203:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784935554.648215:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784935554.648821:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935554.648966:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273160576 00000100:00100000:3.0:1784935554.648976:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273160576 00000100:00100000:3.0:1784935554.649021:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 34 00000100:00100000:3.0:1784935554.649143:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+24:11384:x1871640273160576:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784935554.649401:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+25:11384:x1871640273160576:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 260us (584us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1784935554.651730:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 34 00000100:00100000:3.0:1784935554.734234:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935554.734307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935554.734459:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273160704 00000100:00100000:2.0:1784935554.734481:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273160704 00000100:00100000:2.0:1784935554.734539:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 377 00000100:00100000:2.0:1784935554.734548:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2393:x1871640273160704:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935554.734634:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2393:x1871640273160704:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 86us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935554.734641:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 377 00000100:00100000:0.0:1784935554.734917:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935554.735099:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273161088 00000100:00100000:3.0:1784935554.735105:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273161088 00000100:00100000:3.0:1784935554.735146:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 103 00000100:00100000:3.0:1784935554.735153:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273161088:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935554.735297:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273160832 00000100:00100000:1.0:1784935554.735303:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273160832 00000100:00100000:1.0:1784935554.735342:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 274 00000100:00100000:1.0:1784935554.735350:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273160832:12345-192.168.203.28@tcp:400:kworker.0 00000100:00080000:2.0:1784935554.735412:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784935554.735418:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784935554.739407:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273160832:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 4043us (5084us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935554.739423:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 274 00000100:00100000:0.0:1784935554.739493:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935554.739564:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273161344 00000100:00100000:1.0:1784935554.739572:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273161344 00000100:00100000:1.0:1784935554.739627:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 275 00000100:00100000:1.0:1784935554.739634:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273161344:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935554.742162:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273161088:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 6996us (7231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935554.742178:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 103 00000100:00080000:2.0:1784935554.742225:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935554.743770:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935554.743876:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273161344:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 4237us (4382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935554.743888:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 275 00000100:00100000:3.0:1784935554.744237:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273160960 00000100:00100000:3.0:1784935554.744248:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273160960 00000100:00100000:3.0:1784935554.744404:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 104 00000100:00100000:3.0:1784935554.744412:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273160960:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935554.745126:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273160960:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 712us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935554.745134:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 104 00000100:00100000:2.0:1784935554.745221:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935554.745575:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273161216 00000100:00100000:3.0:1784935554.745582:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273161216 00000100:00100000:3.0:1784935554.745636:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 276 00000100:00100000:3.0:1784935554.745643:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273161216:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935554.745697:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273161216:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 53us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935554.745717:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 276 00000100:00080000:2.0:1784935554.745869:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935554.989183:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292098688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935554.989254:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935554.989521:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292098688 00000100:00100000:1.0:1784935554.989530:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292098688 00000100:00100000:1.0:1784935554.989578:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784935554.989586:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292098688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784935554.989618:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784935554.989686:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292098688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935554.989693:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784935554.989764:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292098688:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784935555.182182:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935556.205171:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784935556.237479:0:14314:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784935556.237489:0:14314:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784935556.237523:0:14314:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1784935556.237530:0:14314:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784935556.368619:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935556.370871:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273161600 00000100:00100000:1.0:1784935556.370884:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273161600 00000100:00100000:1.0:1784935556.371249:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 145 00000100:00100000:1.0:1784935556.371260:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+25:11405:x1871640273161600:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:1.0:1784935556.371292:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935556.371313:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aaf2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.371424:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16f25 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.371439:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16f25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.371451:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16f25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935556.371462:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784935556.371597:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaf2 expref: 28 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.371614:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16f25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaf2 expref: 27 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.371622:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:1.0:1784935556.371625:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784935556.371637:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9a00, rc 0) 00000100:00100000:1.0:1784935556.371698:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+27:11405:x1871640273161600:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 440us (3085us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1784935556.371706:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 145 00000100:00080000:3.0:1784935556.372529:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935556.378358:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935556.378493:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273161728 00000100:00100000:1.0:1784935556.378502:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273161728 00000100:00100000:1.0:1784935556.378599:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 146 00000100:00100000:1.0:1784935556.378610:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+27:11405:x1871640273161728:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:1.0:1784935556.378674:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.378690:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.378702:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.378735:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.378741:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.378747:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.378753:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935556.378757:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.378763:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.378790:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:1.0:1784935556.378793:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784935556.378798:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935556.378804:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b16f33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935556.378883:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+27:11405:x1871640273161728:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 274us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935556.378890:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 146 00000100:00100000:1.0:1784935556.474802:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935556.474917:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273161856 00000100:00100000:2.0:1784935556.474980:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273161856 00000100:00100000:2.0:1784935556.475047:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00080000:3.0:1784935556.475053:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935556.475059:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273161856:12345-192.168.203.28@tcp:101:cat.0 00010000:00010000:2.0:1784935556.475078:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935556.475096:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b16f3a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aaf9 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935556.475120:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a63f481, atime: 0x6a63f480, ctime: 0x6a63f481, blocks: 0x8 00010000:00010000:2.0:1784935556.475139:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1784935556.475144:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935556.475153:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b16f3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaf9 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935556.475172:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b16f3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaf9 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935556.475185:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200200, rc 0) 00000100:00100000:2.0:1784935556.475241:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273161856:12345-192.168.203.28@tcp:101:cat.0 Request processed in 185us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935556.475248:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:0.0:1784935556.480739:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935556.480886:0:8446:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273161984 00000100:00100000:2.0:1784935556.480907:0:8446:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273161984 00002000:00100000:2.0:1784935556.480983:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8d4443d09c00 x1871640273161984/t0(0) o3->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:52/0 lens 488/0 e 0 to 0 dl 1784935567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784935556.480995:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443d09c00 with x1871640273161984 ext(0->4095) 00002000:00010000:2.0:1784935556.481002:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443d09c00 00000100:00100000:2.0:1784935556.481050:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 3 00000100:00100000:2.0:1784935556.481060:0:8446:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273161984:12345-192.168.203.28@tcp:3:cat.0 00000100:00100000:2.0:1784935556.481313:0:8446:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273161984:12345-192.168.203.28@tcp:3:cat.0 Request processed in 254us (583us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784935556.481322:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 3 00002000:00100000:2.0:1784935556.481329:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8d4443d09c00 x1871640273161984/t0(0) o3->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:52/0 lens 488/4536 e 0 to 0 dl 1784935567 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784935556.481338:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443d09c00 with x1871640273161984 ext(0->4095) 00002000:00010000:2.0:1784935556.481342:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443d09c00 00010000:00010000:0.0:1784935557.229836:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935557.551243:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292098816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935557.551322:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935557.551374:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292098816 00000100:00100000:0.0:1784935557.551392:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292098816 00000100:00100000:0.0:1784935557.551446:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784935557.551456:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292098816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935557.551490:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1784935557.551555:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292098816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935557.551562:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784935557.551639:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292098816:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784935558.253297:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935559.086039:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935559.086062:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292098944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935559.086128:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935559.086197:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292098944 00000100:00100000:2.0:1784935559.086204:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292098944 00000100:00100000:1.0:1784935559.086373:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935559.086383:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292099072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935559.086411:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935559.086440:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292099072 00000100:00100000:1.0:1784935559.086443:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292099072 00000100:00100000:1.0:1784935559.086469:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784935559.086477:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292098944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784935559.086505:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935559.086545:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292098944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.086552:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784935559.086567:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784935559.086573:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292099072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935559.086582:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935559.086609:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292099072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.086628:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784935559.086670:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1784935559.086675:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1784935559.086695:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d457402d180, transno 4294967302 00000004:00080000:1.0:1784935559.086706:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1784935559.086715:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d4443d2ed80, transno 4294967305 00000100:00100000:1.0:1784935559.086726:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292099072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935559.087168:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292098944:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784935559.087388:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784935559.089702:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292099200:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.089768:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935559.089806:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292099712:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.089831:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935559.089850:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292100224:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.089871:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935559.089907:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784935559.089914:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292099328:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.089973:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935559.089991:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292099840:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.090010:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935559.090025:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292100352:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.090045:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935559.090078:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292099200 00000100:00100000:1.0:1784935559.090084:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292099200 00000100:00100000:1.0:1784935559.090125:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1784935559.090140:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292099200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.090190:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292099200:12345-0@lo:400:kworker.0 Request processed in 51us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.090197:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1784935559.090231:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292099712 00000100:00100000:1.0:1784935559.090234:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292099712 00000100:00100000:1.0:1784935559.090845:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784935559.090855:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292099712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.090902:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292099712:12345-0@lo:400:kworker.0 Request processed in 49us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.090909:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784935559.090956:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292100224 00000100:00100000:1.0:1784935559.090960:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292100224 00000100:00100000:1.0:1784935559.091007:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784935559.091015:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1871640292100224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.091051:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1871640292100224:12345-0@lo:400:kworker.0 Request processed in 37us (1177us total) trans 0 rc 0/0 00000100:00080000:2.0:1784935559.091052:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935559.091061:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784935559.091086:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292099328 00000100:00100000:1.0:1784935559.091090:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292099328 00000100:00100000:1.0:1784935559.091120:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292099840 00000100:00100000:1.0:1784935559.091124:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292099840 00000100:00100000:1.0:1784935559.091169:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292100352 00000100:00100000:1.0:1784935559.091173:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292100352 00000100:00100000:1.0:1784935559.091189:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1784935559.091196:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292099328:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784935559.091207:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935559.091234:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292099328:12345-0@lo:400:kworker.0 Request processed in 39us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.091246:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000001:00080000:2.0:1784935559.091658:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000004:00080000:2.0:1784935559.091677:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:1.0:1784935559.091682:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1784935559.091693:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292099840:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784935559.091715:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d457d3f2540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1784935559.091720:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d4442920700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d4544f9a180 00000020:00080000:2.0:1784935559.091723:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d4442920f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d4443c19c00 00000100:00100000:1.0:1784935559.091731:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292099840:12345-0@lo:400:kworker.0 Request processed in 40us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.091739:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000020:00080000:2.0:1784935559.091756:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:1.0:1784935559.091757:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1784935559.091767:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292100352:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1784935559.091781:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935559.091793:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935559.091794:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292100352:12345-0@lo:400:kworker.0 Request processed in 27us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.091806:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00010000:2.0:1784935559.091812:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935559.091821:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935559.091826:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935559.091834:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935559.091852:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d454742e900) 00010000:00010000:2.0:1784935559.091855:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935559.091861:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935559.091870:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b16eb5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935559.091881:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292099456:0@lo:400:kworker.0 00000020:00080000:2.0:1784935559.091902:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:1.0:1784935559.091911:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935559.092125:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292099968:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.092149:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935559.092201:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292100480:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.092223:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1784935559.092235:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1784935559.094943:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784935559.100415:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292099584:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.100479:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935559.100895:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292099968 00000100:00100000:3.0:1784935559.100904:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292099968 00000100:00100000:3.0:1784935559.100991:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292100480 00000100:00100000:3.0:1784935559.100995:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292100480 00000100:00100000:3.0:1784935559.101032:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1784935559.101041:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292099968:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784935559.101066:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935559.101104:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292099968:12345-0@lo:400:kworker.0 Request processed in 65us (8953us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935559.101111:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1784935559.101126:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1784935559.101131:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292100480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935559.101157:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292100480:12345-0@lo:400:kworker.0 Request processed in 26us (8934us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935559.101163:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1784935559.102078:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292099328:0@lo:400:kworker.0 00000100:00100000:3.0:1784935559.102094:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292099840:0@lo:400:kworker.0 00000100:00100000:3.0:1784935559.102106:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292100352:0@lo:400:kworker.0 00000100:00100000:3.0:1784935559.102118:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292099200:0@lo:400:kworker.0 00000100:00100000:3.0:1784935559.102128:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292099712:0@lo:400:kworker.0 00000100:00100000:3.0:1784935559.102139:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292100224:0@lo:400:kworker.0 00000100:00100000:0.0:1784935559.104070:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292099456 00000100:00100000:0.0:1784935559.104083:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292099456 00000100:00100000:0.0:1784935559.104135:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784935559.104144:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292099456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935559.104229:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292099456:12345-0@lo:400:kworker.0 Request processed in 86us (12317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935559.104236:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784935559.107006:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292099584 00000100:00100000:1.0:1784935559.107020:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292099584 00000100:00100000:1.0:1784935559.107074:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1784935559.107083:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292099584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.107277:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292099584:12345-0@lo:400:kworker.0 Request processed in 195us (6798us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.107285:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1784935559.107337:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44428afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292099584:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.107349:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292100096:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.107381:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935559.107400:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292100608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784935559.107422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935559.107445:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292100096 00000100:00100000:1.0:1784935559.107448:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292100096 00000100:00100000:1.0:1784935559.107480:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292100608 00000100:00100000:1.0:1784935559.107483:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292100608 00000100:00100000:1.0:1784935559.107498:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784935559.107504:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292100096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.107533:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292100096:12345-0@lo:400:kworker.0 Request processed in 30us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.107539:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784935559.107550:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784935559.107556:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45743c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1871640292100608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1784935559.107673:0:8987:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1784935559.107677:0:8987:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1784935553 -> 1784935553 00002000:00010000:1.0:1784935559.107679:0:8987:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1784935552 -> 1784935552 00002000:00010000:1.0:1784935559.107693:0:8987:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1784935553 -> 1784935553 00002000:00010000:1.0:1784935559.107695:0:8987:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1784935559.107732:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45743c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3649:x1871640292100608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (308us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1784935559.107745:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1784935559.107880:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1784935559.108111:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d4443e79f80/2, rc 0, transno 4294967313 00000100:00100000:1.0:1784935559.108118:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292100608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784935559.108131:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292099456:0@lo:400:kworker.0 00010000:00080000:1.0:1784935559.108145:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44434c6300 x1871640292099968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935559.108154:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292099968:0@lo:400:kworker.0 00010000:00080000:1.0:1784935559.108164:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443e79880 x1871640292100480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935559.108171:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292100480:0@lo:400:kworker.0 00000100:00100000:1.0:1784935559.108193:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292100096:0@lo:400:kworker.0 00000001:00080000:2.0:1784935559.115956:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1784935559.115975:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1784935559.278271:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935559.597667:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292100736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935559.597738:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935559.597819:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292100736 00000100:00100000:3.0:1784935559.597827:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292100736 00000100:00100000:3.0:1784935559.597878:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784935559.597889:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292100736:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935559.597900:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784935559.597911:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292100864:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935559.597917:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784935559.597982:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292100736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935559.597990:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784935559.597997:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935559.598136:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292100736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935559.600766:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292100864 00000100:00100000:3.0:1784935559.600780:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292100864 00000100:00100000:3.0:1784935559.600825:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784935559.600834:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292100864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935559.600860:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784935559.601040:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292100864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 207us (3044us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935559.601048:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784935559.607310:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1784935559.607322:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d4443cd4000, transno 4294967310 00000004:00080000:2.0:1784935559.607447:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967313 00000004:00080000:2.0:1784935559.607473:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d4443e79f80, transno 4294967313 00000100:00100000:2.0:1784935559.607691:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292100864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935559.853634:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935559.853670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935559.853707:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935559.853730:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935559.853749:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935559.853766:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935559.853784:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935559.853811:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273162624 00000100:00100000:1.0:1784935559.853820:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273162624 00000100:00100000:1.0:1784935559.853886:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273162496 00000100:00100000:1.0:1784935559.853889:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273162496 00000100:00100000:1.0:1784935559.853912:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 107 00000100:00100000:1.0:1784935559.853920:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273162624:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935559.854028:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273162624:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 108us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.854035:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 107 00000100:00100000:1.0:1784935559.854052:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 108 00000100:00100000:1.0:1784935559.854059:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2393:x1871640273162496:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935559.854084:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2393:x1871640273162496:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.854090:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 108 00000100:00100000:1.0:1784935559.854108:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273162368 00000100:00100000:1.0:1784935559.854111:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273162368 00000100:00100000:1.0:1784935559.854136:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273162880 00000100:00100000:1.0:1784935559.854139:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273162880 00000100:00100000:1.0:1784935559.854148:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273162240 00000100:00100000:1.0:1784935559.854150:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273162240 00000100:00100000:1.0:1784935559.854162:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273162752 00000100:00100000:1.0:1784935559.854164:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273162752 00000100:00100000:1.0:1784935559.854176:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 283 00000100:00100000:1.0:1784935559.854181:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273162368:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935559.854210:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273162368:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 28us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.854216:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 283 00000100:00100000:1.0:1784935559.854241:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 284 00000100:00100000:1.0:1784935559.854248:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273162880:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935559.854291:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273162880:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 45us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.854298:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 284 00000100:00100000:1.0:1784935559.854310:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 285 00000100:00100000:1.0:1784935559.854315:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+13:2393:x1871640273162240:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935559.854336:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+13:2393:x1871640273162240:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 21us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.854342:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 285 00000100:00100000:1.0:1784935559.854353:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 286 00000100:00100000:1.0:1784935559.854359:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273162752:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935559.854380:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273162752:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 22us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935559.854386:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 286 00000100:00080000:1.0:1784935559.854412:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935559.854415:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784935559.854418:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935559.854420:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935559.854962:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273162112 00000100:00100000:3.0:1784935559.854969:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273162112 00000100:00100000:3.0:1784935559.855233:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 379 00000100:00100000:3.0:1784935559.855243:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2393:x1871640273162112:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935559.855305:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2393:x1871640273162112:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 65us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935559.855312:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 379 00000100:00100000:2.0:1784935560.109399:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935560.111154:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292100992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935560.111828:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935560.122753:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292100992 00000100:00100000:1.0:1784935560.122767:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292100992 00000100:00100000:1.0:1784935560.122839:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784935560.122848:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292100992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784935560.122882:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784935560.122991:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292100992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (11163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935560.122998:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784935560.123154:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292100992:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1784935560.173541:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784935560.302175:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784935560.813201:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784935560.813210:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784935560.813359:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784935560.813369:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784935561.041500:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935561.041588:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273163008 00000100:00100000:2.0:1784935561.041597:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273163008 00000100:00100000:2.0:1784935561.041662:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 147 00000100:00100000:2.0:1784935561.041672:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+13:11058:x1871640273163008:12345-192.168.203.28@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784935561.041769:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+13:11058:x1871640273163008:12345-192.168.203.28@tcp:60:lhsmtool_posix.0 Request processed in 99us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935561.041776:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 147 00000100:00080000:1.0:1784935561.042091:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935561.045975:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935561.046056:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273163136 00000100:00100000:1.0:1784935561.046066:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273163136 00000100:00100000:1.0:1784935561.046145:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 148 00000100:00100000:1.0:1784935561.046157:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:11058:x1871640273163136:12345-192.168.203.28@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1784935561.046264:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:11058:x1871640273163136:12345-192.168.203.28@tcp:60:lhsmtool_posix.0 Request processed in 110us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935561.046272:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 148 00000100:00080000:2.0:1784935561.046427:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935561.052126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935561.064314:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273163392 00000100:00100000:2.0:1784935561.064330:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273163392 00000100:00100000:2.0:1784935561.064402:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 35 00000100:00100000:2.0:1784935561.064413:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+13:11058:x1871640273163392:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784935561.064643:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+14:11058:x1871640273163392:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 231us (12529us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1784935561.064666:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 35 00010000:00010000:0.0:1784935561.325150:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935561.414668:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935561.414762:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273163520 00000100:00100000:2.0:1784935561.414773:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273163520 00000100:00100000:2.0:1784935561.414855:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 149 00000100:00100000:2.0:1784935561.414866:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:11864:x1871640273163520:12345-192.168.203.28@tcp:101:lsof.0 00010000:00010000:2.0:1784935561.414886:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935561.414906:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16f41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab00 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784935561.414956:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784935561.415001:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935561.415015:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935561.415026:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935561.415071:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784935561.415075:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935561.415112:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935561.415148:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16f41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab00 expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935561.415168:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab00 expref: 6 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935561.415191:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:2.0:1784935561.415194:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784935561.415197:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200c00, rc 0) 00000100:00100000:2.0:1784935561.415290:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+6:11864:x1871640273163520:12345-192.168.203.28@tcp:101:lsof.0 Request processed in 426us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935561.415297:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 149 00010000:00010000:1.0:1784935562.349077:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935562.670588:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292101120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935562.670656:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935562.670773:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292101120 00000100:00100000:1.0:1784935562.670781:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292101120 00000100:00100000:1.0:1784935562.670828:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784935562.670837:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4570541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292101120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784935562.670869:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1784935562.670916:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4570541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292101120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935562.670922:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784935562.671040:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292101120:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784935563.373175:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935564.205111:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292101248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935564.205178:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205245:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935564.205251:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292101376:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205293:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205316:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292101760:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205358:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292102272:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205381:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205395:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292102784:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205413:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205430:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784935564.205435:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44421dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292101888:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205460:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205475:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292102400:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205496:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205521:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44435a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292101504:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205556:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205573:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292102016:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205594:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205609:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292102528:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205628:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205641:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784935564.205646:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44435a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292101632:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205667:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205684:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44433d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292102144:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205702:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205717:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292102656:0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.205732:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292101760 00000100:00100000:2.0:1784935564.205740:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292101760 00000100:00100000:1.0:1784935564.205743:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935564.205762:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292101376 00000100:00100000:1.0:1784935564.205765:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292101376 00000100:00100000:2.0:1784935564.205773:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292101504 00000100:00100000:2.0:1784935564.205775:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292101504 00000100:00100000:2.0:1784935564.205785:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292102016 00000100:00100000:2.0:1784935564.205787:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292102016 00000100:00100000:1.0:1784935564.205790:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1784935564.205797:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292101376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.205805:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292102528 00000100:00100000:2.0:1784935564.205808:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292102528 00000100:00100000:2.0:1784935564.205817:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292102144 00000100:00100000:2.0:1784935564.205819:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292102144 00000100:00100000:2.0:1784935564.205830:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292102656 00000100:00100000:2.0:1784935564.205832:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292102656 00000100:00100000:1.0:1784935564.205842:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292101376:12345-0@lo:400:kworker.0 Request processed in 45us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935564.205845:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1784935564.205849:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1784935564.205850:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292101760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205877:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292102272 00000100:00100000:1.0:1784935564.205880:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292102272 00000100:00100000:2.0:1784935564.205883:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292101760:12345-0@lo:400:kworker.0 Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935564.205889:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1784935564.205900:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292102784 00000100:00100000:2.0:1784935564.205901:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1784935564.205903:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292102784 00000100:00100000:2.0:1784935564.205912:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292101504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205914:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292102400 00000100:00100000:1.0:1784935564.205915:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292102400 00000100:00100000:1.0:1784935564.205947:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784935564.205954:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44428afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292102272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.205966:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292101504:12345-0@lo:400:kworker.0 Request processed in 54us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935564.205972:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1784935564.205980:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44428afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292102272:12345-0@lo:400:kworker.0 Request processed in 27us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935564.205984:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784935564.205986:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784935564.205989:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292102016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.205995:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784935564.205999:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44423cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292102784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.206012:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292102016:12345-0@lo:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935564.206018:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784935564.206020:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44423cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292102784:12345-0@lo:400:kworker.0 Request processed in 21us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935564.206025:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784935564.206027:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1784935564.206032:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292102528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.206033:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784935564.206038:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292102400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.206056:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292102528:12345-0@lo:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935564.206057:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292102400:12345-0@lo:400:kworker.0 Request processed in 19us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935564.206061:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1784935564.206068:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784935564.206072:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1784935564.206077:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292102144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.206094:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1784935564.206100:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292102656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.206101:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292102144:12345-0@lo:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935564.206106:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:2.0:1784935564.206120:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784935564.206124:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784935564.206126:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935564.206126:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292102656:12345-0@lo:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00080000:2.0:1784935564.206128:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935564.206132:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1784935564.206148:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292101888 00000100:00100000:1.0:1784935564.206151:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292101888 00010000:00080000:2.0:1784935564.206152:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d44433d6a00 x1871640292102144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935564.206165:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44433d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292102144:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.206168:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292101632 00000100:00100000:1.0:1784935564.206170:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292101632 00000100:00100000:1.0:1784935564.206180:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00010000:00080000:2.0:1784935564.206183:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443600000 x1871640292102656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935564.206185:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45412e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292101888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.206191:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292102656:0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.206201:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44435a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292101504:0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.206209:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292102016:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.206213:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45412e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292101888:12345-0@lo:400:kworker.0 Request processed in 28us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935564.206216:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292102528:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.206218:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784935564.206244:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784935564.206249:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444365fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292101632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.206280:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444365fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292101632:12345-0@lo:400:kworker.0 Request processed in 30us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935564.206283:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44435a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292101632:0@lo:400:kworker.0 00000100:00100000:1.0:1784935564.206286:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784935564.206303:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292101888:0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.206314:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292102400:0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.206322:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44421df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292101760:0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.206330:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292102272:0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.206337:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292102784:0@lo:400:kworker.0 00000100:00100000:2.0:1784935564.206343:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44435a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292101376:0@lo:400:kworker.0 00000100:00100000:0.0:1784935564.206444:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292101248 00000100:00100000:0.0:1784935564.206449:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292101248 00000100:00080000:3.0:1784935564.206475:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935564.206492:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784935564.206508:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292101248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935564.206537:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935564.206572:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292101248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935564.206578:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784935564.206676:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292101248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935564.206688:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935564.206694:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292102912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935564.206720:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935564.206793:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292102912 00000100:00100000:0.0:1784935564.206804:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292102912 00000100:00100000:0.0:1784935564.206865:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784935564.206872:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292102912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784935564.206882:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935564.206924:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292102912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935564.206956:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784935564.207030:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292102912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784935564.397050:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935564.719026:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292103040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935564.719093:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935564.719146:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935564.719153:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44434bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292103168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935564.719178:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935564.719209:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292103040 00000100:00100000:2.0:1784935564.719215:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292103040 00000100:00100000:2.0:1784935564.719273:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292103168 00000100:00100000:2.0:1784935564.719277:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292103168 00000100:00100000:2.0:1784935564.719291:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784935564.719299:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292103040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784935564.719326:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1784935564.719541:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784935564.719551:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292103168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784935564.719565:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1784935564.719607:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292103168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935564.719614:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784935564.719975:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292103040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 676us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935564.719983:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784935564.720046:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292103168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935564.720061:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44434bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292103040:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1784935564.727496:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1784935564.727511:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1784935564.727834:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1784935564.727846:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1784935564.970252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935564.970295:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935564.970323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935564.970343:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935564.970360:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935564.970379:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935564.970419:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935564.970450:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273163904 00000100:00100000:1.0:1784935564.970460:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273163904 00000100:00100000:1.0:1784935564.970526:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273164416 00000100:00100000:1.0:1784935564.970529:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273164416 00000100:00100000:1.0:1784935564.970542:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273163776 00000100:00100000:1.0:1784935564.970545:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273163776 00000100:00100000:1.0:1784935564.970556:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273164288 00000100:00100000:1.0:1784935564.970559:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273164288 00000100:00100000:1.0:1784935564.970573:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 293 00000100:00100000:1.0:1784935564.970581:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273163904:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935564.970651:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273163904:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 71us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935564.970659:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 293 00000100:00100000:3.0:1784935564.970831:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273163648 00000100:00100000:3.0:1784935564.970836:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273163648 00000100:00100000:3.0:1784935564.970866:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 381 00000100:00100000:3.0:1784935564.970873:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273163648:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935564.970901:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273163648:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 28us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935564.970907:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 381 00000100:00100000:1.0:1784935564.971156:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 294 00000100:00100000:1.0:1784935564.971163:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273164416:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935564.971189:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273164416:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 27us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935564.971195:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 294 00000100:00100000:1.0:1784935564.971217:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 295 00000100:00100000:1.0:1784935564.971239:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+13:2394:x1871640273163776:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935564.971270:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+13:2394:x1871640273163776:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 32us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935564.971276:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 295 00000100:00100000:1.0:1784935564.971288:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 296 00000100:00100000:1.0:1784935564.971294:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+6:2394:x1871640273164288:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935564.971318:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+6:2394:x1871640273164288:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 24us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935564.971323:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 296 00000100:00100000:1.0:1784935564.971341:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273164160 00000100:00100000:1.0:1784935564.971344:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273164160 00000100:00100000:1.0:1784935564.971380:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273164032 00000100:00100000:1.0:1784935564.971383:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273164032 00000100:00100000:1.0:1784935564.971404:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 112 00000100:00100000:1.0:1784935564.971410:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273164160:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935564.971433:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273164160:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 23us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935564.971439:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 112 00000100:00100000:1.0:1784935564.971449:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 113 00000100:00100000:1.0:1784935564.971455:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273164032:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935564.971476:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273164032:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 21us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935564.971481:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 113 00000100:00080000:1.0:1784935564.971505:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935564.971515:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784935564.971517:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935564.971519:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:1.0:1784935565.063392:0:14513:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:26:03 (1784935563) 00000100:00100000:2.0:1784935565.231315:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292103296:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935565.231390:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935565.238964:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292103296 00000100:00100000:2.0:1784935565.238990:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292103296 00000100:00100000:2.0:1784935565.239048:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784935565.239059:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44421dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292103296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784935565.239100:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784935565.239211:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44421dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292103296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (7820us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935565.239227:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784935565.239288:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292103296:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784935565.422007:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935566.445224:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935566.487537:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935566.487682:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273164672 00000100:00100000:2.0:1784935566.487691:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273164672 00000100:00080000:1.0:1784935566.487786:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935566.490042:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 150 00000100:00100000:2.0:1784935566.490078:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+13:12131:x1871640273164672:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784935566.490111:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935566.490132:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b16f4f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab07 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490204:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b16f56 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490227:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b16f56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490238:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b16f56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490292:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b16f5d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490300:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b16f5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490306:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b16f5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490395:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16f64 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490403:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16f64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490411:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16f64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935566.490430:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1784935566.490516:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b16f56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490523:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b16f56 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490529:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b16f56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490535:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935566.490538:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b16f56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490545:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b16f56 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490555:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d454918d500) 00010000:00010000:2.0:1784935566.490557:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935566.490562:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b16f56 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490567:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b16f56 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490579:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b16f5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490585:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b16f5d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490600:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b16f5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490605:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935566.490608:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b16f5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490613:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b16f5d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490620:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d44429bbe00) 00010000:00010000:2.0:1784935566.490622:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935566.490624:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b16f5d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490628:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b16f5d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.490873:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b16f4f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab07 expref: 16 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.492068:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16f64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab07 expref: 15 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.492083:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:2.0:1784935566.492086:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935566.492089:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200400, rc 0) 00000100:00100000:2.0:1784935566.494076:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+15:12131:x1871640273164672:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 3999us (6537us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1784935566.494105:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 150 00000100:00100000:1.0:1784935566.499390:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935566.499534:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273164800 00000100:00100000:2.0:1784935566.499543:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273164800 00000100:00100000:2.0:1784935566.499737:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 151 00000100:00100000:2.0:1784935566.499749:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+15:12131:x1871640273164800:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784935566.499910:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+15:12131:x1871640273164800:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 Request processed in 162us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935566.499917:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 151 00000100:00100000:1.0:1784935566.504625:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935566.504905:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273164928 00000100:00100000:2.0:1784935566.504916:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273164928 00000100:00100000:2.0:1784935566.505012:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 152 00000100:00100000:2.0:1784935566.505023:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:12131:x1871640273164928:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1784935566.505415:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784935566.505482:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:12131:x1871640273164928:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 Request processed in 459us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935566.505492:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 152 00000100:00100000:0.0:1784935566.509986:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935566.510176:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273165056 00000100:00100000:2.0:1784935566.510247:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273165056 00000100:00100000:2.0:1784935566.510315:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 12 00000100:00100000:2.0:1784935566.510326:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+15:2391:x1871640273165056:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935566.510342:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935566.510365:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b16f64 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab07 expref: 15 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935566.510386:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:2.0:1784935566.510404:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935566.513835:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+14:2391:x1871640273165056:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 3499us (3896us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935566.513850:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 12 00000040:00080000:1.0:1784935566.960183:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784935566.960192:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784935566.961692:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784935566.961705:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1784935567.341758:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784935567.469416:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935567.789336:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292103424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935567.789407:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935567.793280:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292103424 00000100:00100000:0.0:1784935567.793294:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292103424 00000100:00100000:0.0:1784935567.793394:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784935567.793404:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292103424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935567.793440:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1784935567.793518:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292103424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (4110us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935567.793526:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784935567.793616:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292103424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784935568.239531:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935568.239657:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273165184 00000100:00100000:3.0:1784935568.239668:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273165184 00000100:00100000:3.0:1784935568.239739:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 153 00000100:00100000:3.0:1784935568.239750:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+14:12173:x1871640273165184:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935568.239771:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935568.239790:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16f72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab0e expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.239850:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.239878:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.239891:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.239905:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.239921:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.239952:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.239993:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240000:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240006:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240012:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935568.240016:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240023:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240034:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:3.0:1784935568.240037:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935568.240041:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240047:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b16f79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240061:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240072:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240077:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240082:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935568.240085:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240091:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240100:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d44434a7400) 00010000:00010000:3.0:1784935568.240102:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935568.240105:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240111:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b16f80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240143:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16f72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab0e expref: 15 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240153:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:3.0:1784935568.240155:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935568.240159:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b16f72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab0e expref: 15 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.240254:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021000, rc 0) 00000100:00100000:3.0:1784935568.240315:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+14:12173:x1871640273165184:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 566us (791us total) trans 0 rc 301/301 00000100:00100000:3.0:1784935568.240323:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 153 00000100:00080000:1.0:1784935568.240328:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935568.253321:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.253436:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273165440 00000100:00100000:2.0:1784935568.253446:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273165440 00000100:00100000:2.0:1784935568.253505:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 154 00000100:00100000:2.0:1784935568.253515:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+14:12173:x1871640273165440:12345-192.168.203.28@tcp:36:lfs.0 00010000:00010000:2.0:1784935568.253567:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935568.253604:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b168c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a932 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.256460:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:2.0:1784935568.256544:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935568.256614:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.256632:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab00 expref: 5 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.256641:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.256678:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab00 expref: 5 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.256710:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab00 expref: 5 pid: 6527 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935568.256789:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292103552:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935568.256887:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4561758f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784935568.263996:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935568.264079:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273165568 00000100:00100000:3.0:1784935568.264088:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273165568 00010000:00010000:3.0:1784935568.264138:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab00 expref: 6 pid: 6527 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935568.264187:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 78 00000100:00100000:3.0:1784935568.264206:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372b228c-57a7-4786-b20d-41f2845c5abd+6:2392:x1871640273165568:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935568.264221:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935568.264228:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab00 expref: 6 pid: 6527 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.264242:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab00 expref: 6 pid: 6527 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.264262:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:3.0:1784935568.264267:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.264276:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.264283:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.264315:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935568.264361:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:372b228c-57a7-4786-b20d-41f2845c5abd+6:2392:x1871640273165568:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 165us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935568.264368:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 78 00000100:00080000:1.0:1784935568.264650:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784935568.265410:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16f48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab00 expref: 5 pid: 6527 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935568.265434:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292103552:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935568.265457:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.265467:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.265473:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.265495:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.265505:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.265514:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266081:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266099:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266107:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935568.266123:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f5a08793 reply state 00000000f63f1458 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266133:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266140:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:2.0:1784935568.266142:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784935568.266145:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784935568.266151:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1784935568.266157:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266165:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266171:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266177:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935568.266180:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266187:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266218:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d457d145e00) 00010000:00010000:2.0:1784935568.266220:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935568.266225:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266230:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935568.266246:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f5a08793 reply state 00000000f63f1458 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266254:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.266260:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d44429bb000) 00010000:00010000:2.0:1784935568.266261:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784935568.266263:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1784935568.266352:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+15:12173:x1871640273165440:12345-192.168.203.28@tcp:36:lfs.0 Request processed in 12838us (13038us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1784935568.266361:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 154 00000100:00100000:1.0:1784935568.344015:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.344187:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273165696 00000100:00100000:2.0:1784935568.344209:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273165696 00000100:00100000:2.0:1784935568.344268:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 155 00000100:00100000:2.0:1784935568.344278:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+15:12181:x1871640273165696:12345-192.168.203.28@tcp:101:lctl.0 00010000:00010000:2.0:1784935568.344302:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935568.344323:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab15 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.344383:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16fa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.344408:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.344420:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935568.344472:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784935568.344476:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935568.344496:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.344519:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16f9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab15 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.344535:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab15 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.344544:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d44429bbe00) 00010000:00010000:2.0:1784935568.344547:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784935568.344550:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200c00, rc 0) 00000100:00100000:2.0:1784935568.344610:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+16:12181:x1871640273165696:12345-192.168.203.28@tcp:101:lctl.0 Request processed in 333us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935568.344617:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 155 00000100:00100000:1.0:1784935568.388619:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935568.388868:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273165824 00000100:00100000:0.0:1784935568.388878:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273165824 00000100:00100000:0.0:1784935568.388976:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 156 00000100:00100000:0.0:1784935568.388986:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+16:12187:x1871640273165824:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:0.0:1784935568.389006:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935568.389026:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16faa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab1c expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389086:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16fb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389101:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389113:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389123:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16fb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389131:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389138:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389236:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16fbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389244:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389251:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935568.389297:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1784935568.389300:0:7797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935568.389320:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389332:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389338:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16fb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389345:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389351:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935568.389354:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389362:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16fb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389373:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d44429bbe00) 00010000:00010000:0.0:1784935568.389376:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935568.389380:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16fb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389385:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b16fb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389397:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389412:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389418:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389422:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935568.389426:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389432:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389439:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d44429bb000) 00010000:00010000:0.0:1784935568.389442:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935568.389444:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16fb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389450:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b16fb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389478:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b16faa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab1c expref: 18 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389492:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16fbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab1c expref: 17 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.389500:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:0.0:1784935568.389502:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784935568.389511:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699400, rc 0) 00000100:00100000:0.0:1784935568.389595:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+17:12187:x1871640273165824:12345-192.168.203.28@tcp:101:bash.0 Request processed in 610us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935568.389602:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 156 00000100:00100000:1.0:1784935568.392077:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.393075:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273166080 00000100:00100000:2.0:1784935568.393087:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273166080 00000100:00100000:2.0:1784935568.393217:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 157 00000100:00100000:2.0:1784935568.393228:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+17:12187:x1871640273166080:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:2.0:1784935568.393250:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935568.393284:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b16fc6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab23 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.393373:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16fcd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.393386:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16fcd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.393397:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16fcd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.393812:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.393823:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.393830:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784935568.394212:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1784935568.394344:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16fdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394353:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16fdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394361:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16fdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394395:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16fcd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394414:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16fcd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394421:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16fcd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394426:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935568.394430:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16fcd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394437:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16fcd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394447:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:2.0:1784935568.394450:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935568.394455:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16fcd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394461:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16fcd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935568.394473:0:6527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c0bfed3 reply state 00000000510f29d5 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394484:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394489:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44429bbd00) 00010000:00010000:2.0:1784935568.394492:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784935568.394495:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784935568.394528:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b16fc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab23 expref: 20 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394623:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16fdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab23 expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.394630:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bb600) 00010000:00010000:2.0:1784935568.394633:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935568.394635:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201400, rc 0) 00000100:00100000:2.0:1784935568.394696:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+20:12187:x1871640273166080:12345-192.168.203.28@tcp:101:bash.0 Request processed in 1469us (2627us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1784935568.394703:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 157 00000100:00100000:2.0:1784935568.401820:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935568.405339:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273166208 00000100:00100000:1.0:1784935568.405355:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273166208 00000100:00100000:1.0:1784935568.407164:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 55 00000100:00100000:1.0:1784935568.407180:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273166208:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935568.407211:0:8987:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935568.407233:0:8987:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b16fe9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab2a expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784935568.407269:0:8987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935568.407289:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:1.0:1784935568.407293:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935568.407303:0:8987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b16fe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab2a expref: 6 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.407322:0:8987:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b16fe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab2a expref: 6 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.407335:0:8987:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8a00, rc 0) 00000100:00100000:1.0:1784935568.407390:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2393:x1871640273166208:12345-192.168.203.28@tcp:101:bash.0 Request processed in 216us (5578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935568.407397:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 55 00000100:00080000:3.0:1784935568.411334:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784935568.413560:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.413676:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273166336 00000100:00100000:2.0:1784935568.413686:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273166336 00000100:00100000:2.0:1784935568.413743:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 56 00000100:00100000:2.0:1784935568.413752:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:12187:x1871640273166336:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:2.0:1784935568.413770:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935568.413788:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab31 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.413820:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b16fe9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab2a expref: 7 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.413829:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935568.413833:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935568.413839:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.413903:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b16fe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab2a expref: 7 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.413918:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b16fe9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab2a expref: 7 pid: 8987 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935568.413959:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1871640292103680:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935568.414390:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4561758840 going to sleep for 11 seconds 00000100:00100000:0.0:1784935568.418613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.418735:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1871640292103680:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935568.418767:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.418788:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201800, rc 0) 00000100:00100000:2.0:1784935568.418845:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:12187:x1871640273166336:12345-192.168.203.28@tcp:101:bash.0 Request processed in 5093us (5293us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935568.418853:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 56 00000100:00100000:3.0:1784935568.420127:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273166464 00000100:00100000:3.0:1784935568.420137:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273166464 00010000:00010000:3.0:1784935568.420316:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b16fe9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab2a expref: 7 pid: 8987 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935568.420406:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 79 00000100:00100000:3.0:1784935568.420416:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273166464:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935568.420430:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935568.420461:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b16fe9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab2a expref: 7 pid: 8987 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.420474:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b16fe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab2a expref: 7 pid: 8987 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.420495:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b16fe9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab2a expref: 7 pid: 8987 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.420509:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935568.420514:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935568.420523:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 6 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.420548:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 6 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.420582:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 6 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935568.420595:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6512:1871640292103808:192.168.203.28@tcp:105: 00000100:00100000:3.0:1784935568.420675:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1784935568.422656:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6512:1871640292103808:192.168.203.28@tcp:105: 00010000:00010000:3.0:1784935568.422681:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935568.422736:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273166464:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 2321us (4131us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935568.422747:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 79 00000100:00100000:1.0:1784935568.428028:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935568.428273:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273166720 00000100:00100000:3.0:1784935568.428283:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273166720 00000100:00100000:3.0:1784935568.428335:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 36 00000100:00100000:3.0:1784935568.428344:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+20:12187:x1871640273166720:12345-192.168.203.28@tcp:35:bash.0 00000100:00100000:3.0:1784935568.429145:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+21:12187:x1871640273166720:12345-192.168.203.28@tcp:35:bash.0 Request processed in 798us (1122us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1784935568.429155:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 36 00010000:00010000:1.0:1784935568.493101:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935568.496077:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.496215:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273166976 00000100:00100000:2.0:1784935568.496226:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273166976 00000100:00100000:2.0:1784935568.496302:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 158 00000100:00100000:2.0:1784935568.496312:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+21:12197:x1871640273166976:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935568.496337:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935568.496357:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ff7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab38 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935568.496476:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1784935568.496602:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ff7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab38 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.496615:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d44429bbe00) 00010000:00010000:2.0:1784935568.496619:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784935568.496624:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b16ff7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab38 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.496637:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201000, rc 0) 00000100:00100000:2.0:1784935568.496699:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+22:12197:x1871640273166976:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 388us (631us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1784935568.496705:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 158 00000100:00100000:1.0:1784935568.499260:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.499806:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273167232 00000100:00100000:2.0:1784935568.499816:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273167232 00000100:00100000:2.0:1784935568.500124:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 37 00000100:00100000:2.0:1784935568.500135:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+22:12197:x1871640273167232:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:2.0:1784935568.500385:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+23:12197:x1871640273167232:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 252us (1134us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1784935568.500393:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 37 00000100:00100000:1.0:1784935568.571510:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935568.571599:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273167360 00000100:00100000:3.0:1784935568.571609:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273167360 00000100:00100000:3.0:1784935568.571668:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 159 00000100:00100000:3.0:1784935568.571691:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+23:12203:x1871640273167360:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935568.571714:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935568.571733:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab3f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.571792:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1700c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.571807:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1700c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.571819:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1700c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935568.571862:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1784935568.571866:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935568.571885:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1700c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.571911:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab3f expref: 25 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.571964:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1700c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab3f expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.571974:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:3.0:1784935568.571977:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784935568.571981:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021a00, rc 0) 00000100:00100000:3.0:1784935568.572819:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+24:12203:x1871640273167360:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 1124us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935568.572843:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 159 00000100:00100000:1.0:1784935568.578522:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.578604:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273167616 00000100:00100000:2.0:1784935568.578613:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273167616 00000100:00100000:2.0:1784935568.578669:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 160 00000100:00100000:2.0:1784935568.578679:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+24:12203:x1871640273167616:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935568.578699:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935568.578730:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b17013 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab46 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.578830:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b1701a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.578843:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b1701a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.578865:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b1701a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935568.578878:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784935568.579011:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b17013 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab46 expref: 27 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.579029:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b1701a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab46 expref: 26 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.579049:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bb600) 00010000:00010000:2.0:1784935568.579052:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935568.579055:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200a00, rc 0) 00000100:00100000:2.0:1784935568.579108:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+26:12203:x1871640273167616:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 430us (595us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1784935568.579115:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 160 00000100:00100000:1.0:1784935568.584506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935568.584551:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.584617:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273167872 00000100:00100000:3.0:1784935568.584619:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273168000 00000100:00100000:3.0:1784935568.584626:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273168000 00000100:00100000:2.0:1784935568.584626:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273167872 00000100:00100000:2.0:1784935568.584691:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 161 00000100:00100000:3.0:1784935568.584696:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 13 00000100:00100000:2.0:1784935568.584705:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+27:12203:x1871640273167872:12345-192.168.203.28@tcp:101:lfs.0 00000100:00100000:3.0:1784935568.584708:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+27:2392:x1871640273168000:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935568.584735:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935568.584743:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935568.584760:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200a00/0x857e02f4e0b1701a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab46 expref: 27 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.584762:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b17028 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab4d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.584790:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bb600) 00010000:00010000:3.0:1784935568.584795:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935568.584846:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+27:2392:x1871640273168000:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 142us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935568.584853:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 13 00010000:00010000:2.0:1784935568.584878:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b1702f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.584893:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b1702f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.584904:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b1702f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935568.584916:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784935568.585052:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201e00/0x857e02f4e0b17028 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab4d expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.585065:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b1702f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab4d expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.585072:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bb600) 00010000:00010000:2.0:1784935568.585075:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784935568.585077:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200600, rc 0) 00000100:00100000:2.0:1784935568.585099:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+27:12203:x1871640273167872:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 399us (604us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1784935568.585105:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 161 00000100:00100000:1.0:1784935568.596289:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.596399:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273168128 00000100:00100000:2.0:1784935568.596409:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273168128 00000100:00100000:2.0:1784935568.596465:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 57 00000100:00100000:2.0:1784935568.596488:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2391:x1871640273168128:12345-192.168.203.28@tcp:1:lfs.0 00010000:00010000:2.0:1784935568.596535:0:8987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.596554:0:8987:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 6 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.596563:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935568.596567:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784935568.596571:0:8987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.596604:0:8987:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 6 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.596617:0:8987:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 6 pid: 8440 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935568.596630:0:8987:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8987:1871640292103936:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935568.596721:0:8987:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4561758780 going to sleep for 11 seconds 00000100:00100000:3.0:1784935568.600682:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.600805:0:8987:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8987:1871640292103936:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935568.600834:0:8987:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935568.600922:0:8446:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273168256 00000100:00100000:0.0:1784935568.600962:0:8446:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273168256 00002000:00100000:0.0:1784935568.601005:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8d4443d2dc00 x1871640273168256/t0(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:64/0 lens 504/0 e 0 to 0 dl 1784935579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784935568.601016:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443d2dc00 with x1871640273168256 ext(0->12) 00010000:00010000:0.0:1784935568.601023:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 7 pid: 8440 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.601035:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 7 pid: 8440 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784935568.601043:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4443d2dc00 00000100:00100000:0.0:1784935568.601065:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 2 00000100:00100000:0.0:1784935568.601074:0:8446:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273168256:12345-192.168.203.28@tcp:4:lfs.0 00000100:00100000:0.0:1784935568.602401:0:8446:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2392:x1871640273168256:12345-192.168.203.28@tcp:4:lfs.0 Request processed in 1319us (1720us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784935568.602414:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 2 00002000:00100000:0.0:1784935568.602424:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8d4443d2dc00 x1871640273168256/t4294967306(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:64/0 lens 504/448 e 0 to 0 dl 1784935579 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784935568.602433:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443d2dc00 with x1871640273168256 ext(0->12) 00010000:00010000:0.0:1784935568.602443:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 9 pid: 8440 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.602483:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 9 pid: 8440 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784935568.602492:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4443d2dc00 00000100:00100000:0.0:1784935568.610446:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.610713:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273168384 00000100:00100000:2.0:1784935568.610723:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273168384 00010000:00010000:2.0:1784935568.610793:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 9 pid: 8440 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935568.610838:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 80 00000100:00100000:2.0:1784935568.610848:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2392:x1871640273168384:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935568.610872:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784935568.610890:0:6511:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784935568.610893:0:6511:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784935568 00002000:00010000:2.0:1784935568.610896:0:6511:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784935568 00002000:00010000:2.0:1784935568.610898:0:6511:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1784935568 00002000:00010000:2.0:1784935568.610900:0:6511:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784935568.610906:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 9 pid: 8440 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.610920:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 9 pid: 8440 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.610973:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078caae71/0x857e02f4e0b16ff0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab31 expref: 9 pid: 8440 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.610990:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784935568.610994:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784935568.610999:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.611008:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.611063:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935568.611119:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2392:x1871640273168384:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 272us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935568.611127:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 80 00010000:00010000:1.0:1784935568.611296:0:8987:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.611316:0:8987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.611334:0:8987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.611342:0:8987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.611349:0:8987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.611356:0:8987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935568.611361:0:8987:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.611369:0:8987:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.611382:0:8987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.611389:0:8987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1703d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935568.611447:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273168128:12345-192.168.203.28@tcp:1:lfs.0 Request processed in 14961us (15168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935568.611466:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 57 00000100:00100000:2.0:1784935568.614579:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935568.614742:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273168640 00000100:00100000:3.0:1784935568.614753:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273168640 00000100:00100000:3.0:1784935568.614852:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 38 00000100:00100000:3.0:1784935568.614863:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a09450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+27:12203:x1871640273168640:12345-192.168.203.28@tcp:35:lfs.0 00000004:00010000:3.0:1784935568.614924:0:6529:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b1702f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab4d expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784935568.615294:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1784935568.615346:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1784935568.615827:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1784935568.615866:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.615885:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16fdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab23 expref: 31 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.615894:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.615948:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16fdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab23 expref: 31 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.615964:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16fdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab23 expref: 31 pid: 6527 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935568.615979:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1871640292104064:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935568.617015:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70000 going to sleep for 11 seconds 00000100:00100000:0.0:1784935568.620798:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935568.621021:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273168768 00000100:00100000:3.0:1784935568.621030:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273168768 00010000:00010000:3.0:1784935568.621070:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16fdb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab23 expref: 32 pid: 6527 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935568.621126:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 81 00000100:00100000:3.0:1784935568.621136:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+32:2391:x1871640273168768:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935568.621151:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935568.621159:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16fdb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab23 expref: 32 pid: 6527 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.621180:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16fdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab23 expref: 32 pid: 6527 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.621213:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bb600) 00010000:00010000:3.0:1784935568.621217:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.621227:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.621233:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935568.621252:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935568.621308:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+32:2391:x1871640273168768:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 174us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935568.621315:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 81 00010000:00010000:2.0:1784935568.622980:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b16fdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab23 expref: 31 pid: 6527 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935568.623003:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1871640292104064:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935568.623024:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.623033:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.623039:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784935568.623147:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1784935568.623268:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1784935568.623350:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1871640292104192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784935568.623410:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935568.623443:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45617589c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935568.623588:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292104192 00000100:00100000:3.0:1784935568.623595:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292104192 00000100:00100000:3.0:1784935568.623663:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1784935568.623671:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6529:x1871640292104192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784935568.623761:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6529:x1871640292104192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 91us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935568.623768:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1784935568.623957:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935568.624141:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1871640292104192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1784935568.624262:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1784935568.624302:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1871640292104320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784935568.624330:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935568.624355:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70540 going to sleep for 11 seconds 00000100:00100000:2.0:1784935568.624457:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292104320 00000100:00100000:2.0:1784935568.624462:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292104320 00000100:00100000:2.0:1784935568.624493:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784935568.624500:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6529:x1871640292104320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784935568.624605:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6529:x1871640292104320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (274us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784935568.624612:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784935568.624711:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1871640292104320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1784935568.624744:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1784935568.624774:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.624783:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.624921:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.624959:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935568.624965:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.624973:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.624988:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bb600) 00010000:00010000:0.0:1784935568.624991:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784935568.624995:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.625002:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17044 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784935568.625088:0:6529:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784935568.625152:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1784935568.625162:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387875233559ns, next at 388875231780ns, rc = 0 00000001:00080000:0.0:1784935568.625240:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1784935568.625264:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bb600) 00010000:00010000:0.0:1784935568.625267:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784935568.625274:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b1702f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab4d expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935568.625408:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a09450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+34:12203:x1871640273168640:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 10547us (10839us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1784935568.625417:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 38 00000020:00080000:0.0:1784935568.625421:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784935568.628104:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.628281:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273168896 00000100:00100000:2.0:1784935568.628290:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273168896 00000100:00100000:2.0:1784935568.628385:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 162 00000100:00100000:2.0:1784935568.628396:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+34:12203:x1871640273168896:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935568.628419:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935568.628440:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b1704b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab54 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.628493:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b1704b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab54 expref: 35 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.628507:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b1704b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab54 expref: 35 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.628524:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:2.0:1784935568.628528:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784935568.628531:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201800, rc 0) 00000100:00100000:2.0:1784935568.628588:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+35:12203:x1871640273168896:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 194us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935568.628595:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 162 00000100:00100000:1.0:1784935568.632187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.632333:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273169152 00000100:00100000:2.0:1784935568.632343:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273169152 00000100:00100000:2.0:1784935568.632397:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 39 00000100:00100000:2.0:1784935568.632406:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+35:12203:x1871640273169152:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:2.0:1784935568.632783:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+36:12203:x1871640273169152:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 376us (613us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1784935568.632801:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 39 00000100:00100000:3.0:1784935568.705275:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935568.705503:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273169408 00000100:00100000:0.0:1784935568.705513:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273169408 00000100:00100000:0.0:1784935568.705582:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 163 00000100:00100000:0.0:1784935568.705592:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+36:12213:x1871640273169408:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935568.705614:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935568.705635:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17052 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab5b expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935568.705737:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1784935568.705840:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17052 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab5b expref: 38 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.706403:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d44429bbe00) 00010000:00010000:0.0:1784935568.706408:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784935568.706415:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17052 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab5b expref: 38 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935568.706444:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699000, rc 0) 00000100:00100000:2.0:1784935568.706675:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+37:12213:x1871640273169408:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 1082us (1407us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1784935568.706684:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 163 00000100:00100000:3.0:1784935568.709673:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935568.710043:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273169536 00000100:00100000:1.0:1784935568.710053:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273169536 00000100:00100000:1.0:1784935568.710110:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 164 00000100:00100000:1.0:1784935568.710119:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+37:12213:x1871640273169536:12345-192.168.203.28@tcp:34:lfs.0 00010000:00010000:1.0:1784935568.710188:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17060 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710216:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17060 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710228:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17060 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710240:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17067 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710248:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17067 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710254:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17067 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710325:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1706e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710346:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1706e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710353:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1706e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784935568.710397:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1706e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710408:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17060 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710414:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17060 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710421:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17060 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710426:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935568.710430:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17060 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710437:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17060 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710447:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935568.710461:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935568.710466:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17060 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710472:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17060 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710492:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17067 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710498:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17067 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710504:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17067 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710509:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935568.710512:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17067 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710518:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17067 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710526:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44429bbd00) 00010000:00010000:1.0:1784935568.710528:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935568.710531:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17067 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710537:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17067 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710545:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1706e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710551:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1706e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710557:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1706e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710567:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935568.710571:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1706e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710577:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1706e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710585:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935568.710587:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935568.710590:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1706e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.710595:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1706e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935568.710676:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+37:12213:x1871640273169536:12345-192.168.203.28@tcp:34:lfs.0 Request processed in 556us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935568.710684:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 164 00000100:00100000:1.0:1784935568.713088:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935568.713152:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273169792 00000100:00100000:0.0:1784935568.713160:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273169792 00000100:00100000:0.0:1784935568.713217:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 40 00000100:00100000:0.0:1784935568.713227:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+37:12213:x1871640273169792:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:0.0:1784935568.713414:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+38:12213:x1871640273169792:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 188us (334us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1784935568.713422:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 40 00000100:00100000:3.0:1784935568.747573:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.747667:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273170048 00000100:00100000:2.0:1784935568.747678:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273170048 00000100:00100000:2.0:1784935568.747782:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 165 00000100:00100000:2.0:1784935568.747804:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+38:12216:x1871640273170048:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935568.747828:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935568.747848:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17075 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab62 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.747922:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b1707c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748090:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b1707c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748103:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b1707c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748118:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b17083 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748126:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b17083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748153:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b17083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748272:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1708a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748281:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1708a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748289:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1708a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935568.748299:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784935568.748371:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b1707c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748379:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b1707c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748386:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b1707c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748393:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935568.748396:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b1707c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748403:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b1707c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748414:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:2.0:1784935568.748417:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935568.748427:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b1707c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748433:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b1707c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748446:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b17083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748452:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b17083 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748458:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b17083 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748463:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935568.748466:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b17083 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748473:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b17083 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748482:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44429bbd00) 00010000:00010000:2.0:1784935568.748484:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935568.748486:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b17083 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748492:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b17083 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748530:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17075 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab62 expref: 41 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748556:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1708a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab62 expref: 40 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935568.748564:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:2.0:1784935568.748566:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935568.748569:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200000, rc 0) 00000100:00100000:2.0:1784935568.748683:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+40:12216:x1871640273170048:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 881us (1118us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1784935568.748691:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 165 00000100:00100000:0.0:1784935568.759013:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935568.759106:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273170176 00000100:00100000:1.0:1784935568.759116:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273170176 00000100:00100000:1.0:1784935568.759180:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 166 00000100:00100000:1.0:1784935568.759190:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+40:12216:x1871640273170176:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:1.0:1784935568.759262:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b17098 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.759352:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b17098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.759385:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b17098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.759419:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b17098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.759426:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b17098 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.759433:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b17098 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.759439:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935568.759444:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b17098 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.759451:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b17098 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.759462:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935568.759465:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784935568.759470:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b17098 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935568.759476:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b17098 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935568.759554:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+40:12216:x1871640273170176:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 364us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935568.759562:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 166 00000100:00100000:0.0:1784935568.764557:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935568.764641:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273170432 00000100:00100000:2.0:1784935568.764651:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273170432 00000100:00100000:2.0:1784935568.764735:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 41 00000100:00100000:2.0:1784935568.764746:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+40:12216:x1871640273170432:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:2.0:1784935568.765817:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+41:12216:x1871640273170432:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 1068us (1264us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1784935568.765827:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 41 00000100:00100000:0.0:1784935569.065334:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935569.065434:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273170688 00000100:00100000:2.0:1784935569.065443:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273170688 00000100:00100000:2.0:1784935569.065510:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 167 00000100:00100000:2.0:1784935569.065520:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+41:12247:x1871640273170688:12345-192.168.203.28@tcp:101:cat.0 00010000:00010000:2.0:1784935569.065544:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935569.065563:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b1709f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab69 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.065686:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b170a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.065706:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b170a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.065923:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b170a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935569.065979:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784935569.066083:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b1709f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab69 expref: 44 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.066101:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b170a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab69 expref: 43 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.066108:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:2.0:1784935569.066111:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935569.066114:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200800, rc 0) 00000100:00100000:2.0:1784935569.066163:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+43:12247:x1871640273170688:12345-192.168.203.28@tcp:101:cat.0 Request processed in 644us (838us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1784935569.066170:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 167 00000100:00100000:0.0:1784935569.070028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935569.070134:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273170944 00000100:00100000:1.0:1784935569.070155:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273170944 00000100:00100000:1.0:1784935569.070219:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 42 00000100:00100000:1.0:1784935569.070230:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+43:12247:x1871640273170944:12345-192.168.203.28@tcp:35:cat.0 00000100:00100000:1.0:1784935569.070444:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+44:12247:x1871640273170944:12345-192.168.203.28@tcp:35:cat.0 Request processed in 215us (423us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1784935569.070452:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 42 00000100:00100000:0.0:1784935569.071246:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935569.071312:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273171072 00000100:00100000:2.0:1784935569.071319:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273171072 00000100:00100000:2.0:1784935569.071364:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00100000:2.0:1784935569.071372:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+44:2391:x1871640273171072:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935569.071385:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935569.071406:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b170a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab69 expref: 44 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.071442:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:2.0:1784935569.071447:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935569.071482:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+43:2391:x1871640273171072:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935569.071489:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00100000:0.0:1784935569.133509:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935569.133674:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273171328 00000100:00100000:3.0:1784935569.133684:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273171328 00000100:00100000:3.0:1784935569.133753:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 168 00000100:00100000:3.0:1784935569.133762:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+43:12253:x1871640273171328:12345-192.168.203.28@tcp:101:dd.0 00010000:00010000:3.0:1784935569.133786:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935569.133789:0:12375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784935569.133813:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1700c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab3f expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.133834:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:3.0:1784935569.133839:0:12375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784935569.133860:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b170b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab70 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.134004:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.134019:0:12375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1708a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab62 expref: 43 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.134027:0:12375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.134072:0:12375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1708a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab62 expref: 43 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.134084:0:12375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1708a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab62 expref: 43 pid: 12375 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935569.134096:0:12375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292104448:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935569.134181:0:12375:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd540 going to sleep for 11 seconds 00000100:00100000:3.0:1784935569.136569:0:12375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292104448:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935569.136595:0:12375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935569.136723:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935569.137179:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273171456 00000100:00100000:3.0:1784935569.137187:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273171456 00010000:00010000:3.0:1784935569.137228:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1708a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab62 expref: 44 pid: 12375 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935569.137268:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 82 00000100:00100000:3.0:1784935569.137279:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566e68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+44:2393:x1871640273171456:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935569.137293:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935569.137299:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1708a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab62 expref: 44 pid: 12375 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.137310:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1708a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab62 expref: 44 pid: 12375 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.137499:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1708a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab62 expref: 44 pid: 12375 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.137515:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:3.0:1784935569.137519:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.137528:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.137535:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.137621:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935569.137686:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566e68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+43:2393:x1871640273171456:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 409us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.137695:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 82 00010000:00010000:2.0:1784935569.142156:0:12375:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.142182:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935569.142213:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784935569.142373:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020a00/0x857e02f4e0b170b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab70 expref: 44 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.142397:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab70 expref: 43 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.142407:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:2.0:1784935569.142410:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784935569.142413:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021000, rc 0) 00000100:00100000:2.0:1784935569.142473:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+43:12253:x1871640273171328:12345-192.168.203.28@tcp:101:dd.0 Request processed in 8711us (8972us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1784935569.142482:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 168 00000100:00100000:0.0:1784935569.147318:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935569.147557:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273171584 00000100:00100000:1.0:1784935569.147567:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273171584 00000100:00100000:1.0:1784935569.147634:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 169 00000100:00100000:1.0:1784935569.147646:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+43:12253:x1871640273171584:12345-192.168.203.28@tcp:101:dd.0 00010000:00010000:1.0:1784935569.147670:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935569.147691:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b170c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab77 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.147723:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b170d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.147747:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b170d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.147759:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b170d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.147882:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b170c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab77 expref: 45 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.147897:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b170d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab77 expref: 44 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.147916:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935569.147918:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784935569.147922:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8e00, rc 0) 00000100:00100000:1.0:1784935569.148018:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+44:12253:x1871640273171584:12345-192.168.203.28@tcp:101:dd.0 Request processed in 374us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935569.148025:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 169 00000100:00100000:0.0:1784935569.151512:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935569.151797:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273171840 00000100:00100000:1.0:1784935569.151807:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273171840 00000100:00100000:1.0:1784935569.151871:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 170 00000100:00100000:1.0:1784935569.151881:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+44:12253:x1871640273171840:12345-192.168.203.28@tcp:36:dd.0 00010000:00010000:1.0:1784935569.152120:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.152134:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.152143:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784935569.152177:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1784935569.152208:0:6525:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c41c61a4 reply state 000000006216b812 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.152221:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.152228:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935569.152231:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784935569.152248:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784935569.152334:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+47:12253:x1871640273171840:12345-192.168.203.28@tcp:36:dd.0 Request processed in 454us (831us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1784935569.152340:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 170 00000020:00080000:1.0:1784935569.152345:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784935569.325183:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935569.325215:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44437bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292104576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935569.325296:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935569.325492:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292104576 00000100:00100000:3.0:1784935569.325499:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292104576 00000100:00100000:3.0:1784935569.325553:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784935569.325578:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44434bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292104576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784935569.325600:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935569.325645:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44434bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292104576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.325653:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1784935569.325673:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784935569.325751:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935569.325764:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292104704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935569.325799:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935569.326737:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292104960:0@lo:400:kworker.0 00000100:00100000:0.0:1784935569.326775:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935569.327338:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292104832:0@lo:400:kworker.0 00000100:00100000:1.0:1784935569.327375:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935569.328537:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292105472:0@lo:400:kworker.0 00000100:00100000:0.0:1784935569.328582:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935569.328613:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292105984:0@lo:400:kworker.0 00000100:00100000:0.0:1784935569.328635:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935569.328679:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292105088:0@lo:400:kworker.0 00000100:00100000:0.0:1784935569.328791:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935569.328815:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292105600:0@lo:400:kworker.0 00000100:00100000:0.0:1784935569.328838:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935569.328857:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457d32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292106112:0@lo:400:kworker.0 00000100:00100000:0.0:1784935569.328876:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935569.328893:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784935569.328899:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292105216:0@lo:400:kworker.0 00000100:00100000:0.0:1784935569.329006:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935569.329024:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292105728:0@lo:400:kworker.0 00000100:00100000:0.0:1784935569.329046:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935569.329171:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292105344:0@lo:400:kworker.0 00000100:00100000:1.0:1784935569.329217:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935569.329238:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292105856:0@lo:400:kworker.0 00000100:00100000:1.0:1784935569.329268:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292105088 00000100:00100000:1.0:1784935569.329274:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292105088 00000100:00100000:1.0:1784935569.329313:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292105344 00000100:00100000:1.0:1784935569.329316:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292105344 00000100:00100000:1.0:1784935569.329330:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784935569.329337:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292105088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935569.329387:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292105088:12345-0@lo:400:kworker.0 Request processed in 50us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935569.329393:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784935569.329408:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784935569.329414:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292105344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935569.329447:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292105344:12345-0@lo:400:kworker.0 Request processed in 33us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935569.329453:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784935569.329798:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292104704 00000100:00100000:3.0:1784935569.329809:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292104704 00000100:00100000:3.0:1784935569.329837:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784935569.329843:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292104704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784935569.329858:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935569.330156:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292104960 00000100:00100000:1.0:1784935569.330162:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292104960 00000100:00100000:1.0:1784935569.330181:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292105472 00000100:00100000:1.0:1784935569.330183:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292105472 00000100:00100000:1.0:1784935569.330219:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292105984 00000100:00100000:1.0:1784935569.330222:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292105984 00000100:00100000:1.0:1784935569.330233:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292105600 00000100:00100000:1.0:1784935569.330235:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292105600 00000100:00100000:1.0:1784935569.330245:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292106112 00000100:00100000:1.0:1784935569.330247:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292106112 00000100:00100000:1.0:1784935569.330256:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292105216 00000100:00100000:1.0:1784935569.330257:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292105216 00000100:00100000:1.0:1784935569.330269:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1784935569.330275:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292104960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.331712:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292104704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1862us (5907us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.331822:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784935569.331867:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292104832 00000100:00100000:3.0:1784935569.331873:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292104832 00000100:00100000:3.0:1784935569.331919:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1784935569.331941:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292104832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.331985:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292104832:12345-0@lo:400:kworker.0 Request processed in 60us (4610us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.331992:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1784935569.332046:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1784935569.332253:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292105472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.332300:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292105472:12345-0@lo:400:kworker.0 Request processed in 247us (3718us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.332307:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1784935569.332322:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1784935569.332329:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292105984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.332357:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292105984:12345-0@lo:400:kworker.0 Request processed in 29us (3722us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.332363:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1784935569.332374:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1784935569.332380:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292105600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.332424:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292105600:12345-0@lo:400:kworker.0 Request processed in 44us (3585us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.332430:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1784935569.332442:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1784935569.332448:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292106112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.332473:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292106112:12345-0@lo:400:kworker.0 Request processed in 26us (3597us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.332478:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1784935569.332489:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784935569.332495:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292105216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.332521:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292105216:12345-0@lo:400:kworker.0 Request processed in 26us (3515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.332526:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784935569.332562:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292105728 00000100:00100000:3.0:1784935569.332567:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292105728 00000100:00100000:3.0:1784935569.332595:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784935569.332600:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292105728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.332629:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292105728:12345-0@lo:400:kworker.0 Request processed in 29us (3582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.332634:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784935569.332653:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935569.332702:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292104832:0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.332716:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292105344:0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.335204:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292105856 00000100:00100000:3.0:1784935569.335213:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292105856 00000100:00100000:3.0:1784935569.335291:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784935569.335299:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292105856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.335391:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292105856:12345-0@lo:400:kworker.0 Request processed in 92us (2737us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.335398:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784935569.335439:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292105856:0@lo:400:kworker.0 00000100:00080000:3.0:1784935569.335475:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784935569.335479:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784935569.335483:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935569.335515:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292105472:0@lo:400:kworker.0 00000100:00100000:3.0:1784935569.335527:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292105984:0@lo:400:kworker.0 00000100:00100000:1.0:1784935569.335690:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292104960:12345-0@lo:400:kworker.0 Request processed in 5413us (8912us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935569.335698:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1784935569.335879:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292104960:0@lo:400:kworker.0 00000100:00100000:2.0:1784935569.337043:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44437bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292104576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935569.337361:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292105728:0@lo:400:kworker.0 00000100:00100000:0.0:1784935569.337375:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292105088:0@lo:400:kworker.0 00010000:00080000:0.0:1784935569.337388:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443cd5c00 x1871640292105600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935569.337398:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292105600:0@lo:400:kworker.0 00010000:00080000:0.0:1784935569.337409:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d457d32c000 x1871640292106112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935569.337417:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457d32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292106112:0@lo:400:kworker.0 00000100:00100000:0.0:1784935569.337435:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292104704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935569.337463:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292105216:0@lo:400:kworker.0 00000100:00100000:0.0:1784935569.419908:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935569.420628:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273171968 00000100:00100000:3.0:1784935569.420640:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273171968 00000100:00100000:3.0:1784935569.420763:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 171 00000100:00100000:3.0:1784935569.420775:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+47:12267:x1871640273171968:12345-192.168.203.28@tcp:101:stat.0 00010000:00010000:3.0:1784935569.420799:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935569.420820:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170de lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab7e expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.420887:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b170e5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.420900:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b170e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.420912:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b170e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.420966:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b170ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.420975:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b170ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.420982:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b170ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.421066:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.421077:0:12375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab70 expref: 48 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.421085:0:12375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.421116:0:12375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab70 expref: 48 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.421128:0:12375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab70 expref: 48 pid: 12375 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935569.421141:0:12375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292106240:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935569.421260:0:12375:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935569.434988:0:12375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292106240:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935569.435017:0:12375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935569.435303:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935569.435403:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273172224 00000100:00100000:1.0:1784935569.435410:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273172224 00000100:00100000:1.0:1784935569.435466:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 43 00000100:00100000:1.0:1784935569.435477:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+49:6159:x1871640273172224:12345-192.168.203.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784935569.435744:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+50:6159:x1871640273172224:12345-192.168.203.28@tcp:35:ldlm_bl.0 Request processed in 259us (433us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1784935569.435753:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 43 00000100:00100000:0.0:1784935569.439265:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935569.439607:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273172352 00000100:00100000:2.0:1784935569.439617:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273172352 00010000:00010000:2.0:1784935569.439657:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab70 expref: 50 pid: 12375 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935569.439699:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 83 00000100:00100000:2.0:1784935569.439707:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+50:2392:x1871640273172352:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935569.439721:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935569.439727:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab70 expref: 50 pid: 12375 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.439739:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab70 expref: 50 pid: 12375 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.439760:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b170bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab70 expref: 50 pid: 12375 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.439779:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:2.0:1784935569.439785:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.439795:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.439803:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935569.439841:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935569.439897:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+49:2392:x1871640273172352:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 190us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935569.439904:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 83 00010000:00010000:3.0:1784935569.444524:0:12375:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444542:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935569.444600:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784935569.444604:0:12375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935569.444625:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444641:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444651:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b170e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444657:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b170e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444664:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b170e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444670:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935569.444675:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b170e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444683:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b170e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444697:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:3.0:1784935569.444718:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935569.444724:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b170e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444740:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b170e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444761:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b170ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444767:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b170ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444773:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b170ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444778:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935569.444781:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b170ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444786:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b170ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444795:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44429bbd00) 00010000:00010000:3.0:1784935569.444797:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935569.444800:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b170ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444806:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b170ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444843:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170de lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab7e expref: 49 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444871:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab7e expref: 48 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.444878:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:3.0:1784935569.444880:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784935569.444883:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020800, rc 0) 00000100:00100000:3.0:1784935569.444979:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+48:12267:x1871640273171968:12345-192.168.203.28@tcp:101:stat.0 Request processed in 24204us (25078us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.444987:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 171 00000100:00100000:0.0:1784935569.515608:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935569.515668:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273172608 00000100:00100000:3.0:1784935569.515678:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273172608 00000100:00100000:3.0:1784935569.515739:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 172 00000100:00100000:3.0:1784935569.515750:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+48:12273:x1871640273172608:12345-192.168.203.28@tcp:36:truncate.0 00010000:00010000:3.0:1784935569.515804:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935569.515830:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b170f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab7e expref: 48 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.515851:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:3.0:1784935569.515855:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784935569.516639:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.516656:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.516665:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784935569.516715:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1784935569.516739:0:6525:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ea08f46 reply state 00000000c92ffc7f transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.516751:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.516758:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:3.0:1784935569.516760:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784935569.516763:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784935569.516884:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+50:12273:x1871640273172608:12345-192.168.203.28@tcp:36:truncate.0 Request processed in 1135us (1284us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1784935569.516891:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 172 00000020:00080000:3.0:1784935569.516896:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784935569.518203:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935569.685184:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935569.685322:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273172736 00000100:00100000:1.0:1784935569.685331:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273172736 00000100:00100000:1.0:1784935569.685394:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 173 00000100:00100000:1.0:1784935569.685404:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+50:12287:x1871640273172736:12345-192.168.203.28@tcp:101:stat.0 00010000:00010000:1.0:1784935569.685428:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935569.685462:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17101 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab85 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685527:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b17108 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685541:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b17108 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685551:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b17108 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685562:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1710f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685570:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1710f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685576:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1710f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685637:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685646:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685653:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935569.685688:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1784935569.685692:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935569.685711:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685727:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685736:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b17108 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685855:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b17108 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685864:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b17108 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685871:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935569.685875:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b17108 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685883:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b17108 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685894:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935569.685897:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935569.685901:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b17108 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685907:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b17108 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685920:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1710f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685965:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1710f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685977:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1710f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685983:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935569.685986:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1710f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.685992:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1710f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.686001:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44429bbd00) 00010000:00010000:1.0:1784935569.686003:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935569.686006:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1710f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.686012:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1710f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.686039:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17101 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab85 expref: 52 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.686053:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab85 expref: 51 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.686060:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935569.686062:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935569.686064:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8c00, rc 0) 00000100:00100000:1.0:1784935569.686132:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+51:12287:x1871640273172736:12345-192.168.203.28@tcp:101:stat.0 Request processed in 728us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935569.686148:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 173 00000100:00100000:0.0:1784935569.763489:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935569.764440:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273172992 00000100:00100000:3.0:1784935569.764454:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273172992 00000100:00100000:3.0:1784935569.764532:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 174 00000100:00100000:3.0:1784935569.764543:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+51:12297:x1871640273172992:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935569.764568:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935569.764589:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b1711d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab8c expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935569.764714:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784935569.764808:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b1711d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab8c expref: 53 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.764822:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d44429bbe00) 00010000:00010000:3.0:1784935569.764825:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784935569.764837:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b1711d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab8c expref: 53 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.764854:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020800, rc 0) 00000100:00100000:3.0:1784935569.764921:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+52:12297:x1871640273172992:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 380us (1443us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1784935569.764977:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 174 00000100:00100000:0.0:1784935569.777419:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935569.778043:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273173248 00000100:00100000:2.0:1784935569.778055:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273173248 00000100:00100000:2.0:1784935569.778121:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 44 00000100:00100000:2.0:1784935569.778131:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a09c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+52:12297:x1871640273173248:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:2.0:1784935569.778396:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a09c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+53:12297:x1871640273173248:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 265us (987us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1784935569.778404:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 44 00000100:00100000:0.0:1784935569.838012:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292106368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935569.838090:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784935569.838092:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935569.838108:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292106496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935569.838147:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935569.838229:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292106368 00000100:00100000:3.0:1784935569.838237:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292106368 00000100:00100000:3.0:1784935569.838286:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292106496 00000100:00100000:3.0:1784935569.838289:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292106496 00000100:00100000:3.0:1784935569.838304:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784935569.838312:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292106368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784935569.838341:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784935569.838397:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292106368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.838403:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784935569.838418:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784935569.838425:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292106496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935569.838434:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784935569.838461:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292106496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.838467:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784935569.838985:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292106496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935569.839026:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292106368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935569.850119:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935569.851180:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273173504 00000100:00100000:3.0:1784935569.851202:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273173504 00000100:00100000:3.0:1784935569.851271:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 175 00000100:00100000:3.0:1784935569.851282:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+53:12303:x1871640273173504:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:3.0:1784935569.851326:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935569.851349:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b1712b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab93 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.851454:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.851469:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab85 expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.851478:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.852313:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab85 expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.852331:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab85 expref: 54 pid: 6526 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935569.852345:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292106624:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935569.852532:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935569.858262:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935569.858476:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292106624:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935569.858512:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935569.858955:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273173632 00000100:00100000:1.0:1784935569.858963:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273173632 00010000:00010000:1.0:1784935569.859000:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab85 expref: 55 pid: 6526 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935569.859039:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 84 00000100:00100000:1.0:1784935569.859048:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+55:2392:x1871640273173632:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935569.859063:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935569.859069:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab85 expref: 55 pid: 6526 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.859080:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab85 expref: 55 pid: 6526 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.859101:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17116 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab85 expref: 55 pid: 6526 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.859115:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935569.859120:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.859129:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.859150:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.859181:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784935569.859429:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.859437:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935569.859461:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1784935569.859598:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b1712b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab93 expref: 56 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.859617:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab93 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.859624:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:3.0:1784935569.859626:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784935569.859628:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020c00, rc 0) 00000100:00100000:1.0:1784935569.859681:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+55:2392:x1871640273173632:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 634us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935569.859689:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 84 00000100:00100000:3.0:1784935569.861204:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+54:12303:x1871640273173504:12345-192.168.203.28@tcp:101:bash.0 Request processed in 9906us (11076us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1784935569.861215:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 175 00000100:00100000:0.0:1784935569.864562:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935569.864635:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273173888 00000100:00100000:1.0:1784935569.864652:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273173888 00000100:00100000:1.0:1784935569.864710:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 176 00000100:00100000:1.0:1784935569.864720:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+54:12303:x1871640273173888:12345-192.168.203.28@tcp:36:bash.0 00010000:00010000:1.0:1784935569.864973:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.864990:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.865002:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784935569.865046:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1784935569.865067:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009424726b reply state 000000009c7eb56b transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.865079:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935569.865086:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935569.865089:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784935569.865104:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784935569.865207:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+57:12303:x1871640273173888:12345-192.168.203.28@tcp:36:bash.0 Request processed in 488us (652us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1784935569.865215:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 176 00000020:00080000:1.0:1784935569.865219:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784935569.871051:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935569.871138:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273174016 00000100:00100000:3.0:1784935569.871148:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273174016 00000100:00100000:3.0:1784935569.871225:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 177 00000100:00100000:3.0:1784935569.871235:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+57:12303:x1871640273174016:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:3.0:1784935569.871259:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935569.871279:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17147 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ab9a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.871366:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1714e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.871382:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab93 expref: 58 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.871411:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1714e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.871445:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab93 expref: 58 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.871466:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab93 expref: 58 pid: 6525 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935569.871479:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292106752:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935569.871561:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935569.873657:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292106752:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935569.873682:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1714e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935569.874980:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935569.875118:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273174144 00000100:00100000:3.0:1784935569.875128:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273174144 00010000:00010000:3.0:1784935569.875178:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab93 expref: 59 pid: 6525 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935569.875230:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 85 00000100:00100000:3.0:1784935569.875242:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+59:2392:x1871640273174144:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935569.875260:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935569.875268:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab93 expref: 59 pid: 6525 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.875303:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab93 expref: 59 pid: 6525 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.875329:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17132 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab93 expref: 59 pid: 6525 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.875346:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:3.0:1784935569.875351:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1714e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.875360:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1714e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.875367:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1714e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.875417:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935569.875478:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+58:2392:x1871640273174144:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 239us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.875486:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 85 00010000:00010000:0.0:1784935569.875770:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1714e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935569.875778:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1714e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935569.875828:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1784935569.875832:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935569.875863:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1714e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935569.875891:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17147 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab9a expref: 58 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935569.875908:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1714e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab9a expref: 57 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935569.875972:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:0.0:1784935569.875976:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935569.875978:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020000, rc 0) 00000100:00100000:0.0:1784935569.876006:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+57:12303:x1871640273174016:12345-192.168.203.28@tcp:101:bash.0 Request processed in 4772us (4964us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935569.876012:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 177 00000100:00100000:0.0:1784935569.878233:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935569.878317:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273174400 00000100:00100000:2.0:1784935569.878327:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273174400 00000100:00100000:2.0:1784935569.878381:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 45 00000100:00100000:2.0:1784935569.878391:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+57:12303:x1871640273174400:12345-192.168.203.28@tcp:35:bash.0 00000100:00100000:2.0:1784935569.878608:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+58:12303:x1871640273174400:12345-192.168.203.28@tcp:35:bash.0 Request processed in 217us (383us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1784935569.878615:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 45 00000100:00100000:1.0:1784935569.955558:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935569.955695:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273174656 00000100:00100000:3.0:1784935569.955706:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273174656 00000100:00100000:3.0:1784935569.955801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 178 00000100:00100000:3.0:1784935569.955811:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+58:12313:x1871640273174656:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935569.955852:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935569.955873:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17155 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aba1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935569.956013:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784935569.956103:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17155 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aba1 expref: 60 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.956116:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d44429bbe00) 00010000:00010000:3.0:1784935569.956120:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784935569.956124:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020c00/0x857e02f4e0b17155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aba1 expref: 60 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.956140:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020c00, rc 0) 00000100:00100000:3.0:1784935569.956258:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+59:12313:x1871640273174656:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 448us (710us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1784935569.956263:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 178 00000100:00100000:0.0:1784935569.959672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935569.959862:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273174784 00000100:00100000:3.0:1784935569.959872:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273174784 00000100:00100000:3.0:1784935569.960007:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 179 00000100:00100000:3.0:1784935569.960019:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+59:12313:x1871640273174784:12345-192.168.203.28@tcp:34:lfs.0 00010000:00010000:3.0:1784935569.960105:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17163 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960121:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17163 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960132:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17163 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960142:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b1716a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960156:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b1716a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960163:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b1716a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960239:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17171 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960249:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960256:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784935569.960301:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960313:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17163 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960320:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17163 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960326:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17163 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960333:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935569.960337:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17163 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960344:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17163 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960363:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:3.0:1784935569.960366:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935569.960370:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17163 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960377:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17163 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960392:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b1716a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960398:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b1716a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960403:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b1716a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960408:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935569.960410:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b1716a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960415:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b1716a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960422:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44429bbd00) 00010000:00010000:3.0:1784935569.960424:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935569.960427:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b1716a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960432:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b1716a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960452:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960457:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17171 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960463:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17171 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960468:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935569.960471:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17171 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960477:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17171 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960484:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:3.0:1784935569.960487:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935569.960489:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17171 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935569.960494:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17171 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935569.960571:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+59:12313:x1871640273174784:12345-192.168.203.28@tcp:34:lfs.0 Request processed in 554us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935569.960579:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 179 00000100:00100000:0.0:1784935569.963769:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935569.963859:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273175040 00000100:00100000:2.0:1784935569.963868:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273175040 00000100:00100000:2.0:1784935569.964009:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 46 00000100:00100000:2.0:1784935569.964020:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+59:12313:x1871640273175040:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:2.0:1784935569.964258:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+60:12313:x1871640273175040:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 241us (499us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1784935569.964266:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 46 00000100:00100000:1.0:1784935570.013865:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935570.014076:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273175296 00000100:00100000:0.0:1784935570.014087:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273175296 00000100:00100000:0.0:1784935570.014222:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 180 00000100:00100000:0.0:1784935570.014233:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+60:12316:x1871640273175296:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935570.014263:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935570.014282:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b17178 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aba8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014363:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1717f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014377:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1717f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014388:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1717f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014398:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17186 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014420:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014428:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014538:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1718d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014547:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1718d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014554:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1718d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935570.014564:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784935570.014633:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1717f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014653:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1717f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014660:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1717f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014667:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935570.014671:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1717f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014678:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1717f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014699:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:0.0:1784935570.014702:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935570.014707:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1717f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014713:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b1717f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014728:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014734:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17186 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014741:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17186 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014746:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935570.014749:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17186 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014756:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17186 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014763:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44429bbd00) 00010000:00010000:0.0:1784935570.014765:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935570.014768:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17186 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014774:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17186 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014820:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b17178 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aba8 expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014833:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1718d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aba8 expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.014840:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:0.0:1784935570.014843:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935570.014845:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699c00, rc 0) 00000100:00100000:0.0:1784935570.015220:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+62:12316:x1871640273175296:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 987us (1362us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1784935570.015228:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 180 00000100:00080000:3.0:1784935570.015697:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935570.019059:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935570.019105:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935570.019664:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273175424 00000100:00100000:3.0:1784935570.019674:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273175424 00000100:00100000:3.0:1784935570.019752:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 181 00000100:00100000:3.0:1784935570.019762:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+62:12316:x1871640273175424:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:3.0:1784935570.019830:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1719b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.019857:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1719b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.019869:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1719b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.019906:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1719b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.019914:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1719b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.019919:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1719b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.019949:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935570.019954:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1719b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.019962:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1719b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.019975:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:3.0:1784935570.019978:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784935570.019984:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1719b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.020001:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1719b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935570.020087:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+62:12316:x1871640273175424:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 326us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935570.020095:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 181 00000100:00100000:1.0:1784935570.020539:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273175552 00000100:00100000:1.0:1784935570.020546:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273175552 00000100:00100000:1.0:1784935570.020583:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00100000:1.0:1784935570.020591:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+62:2392:x1871640273175552:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935570.020602:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935570.020617:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1718d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aba8 expref: 62 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935570.020631:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935570.020634:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935570.020666:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+61:2392:x1871640273175552:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 76us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935570.020673:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 15 00000040:00080000:1.0:1784935570.029228:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784935570.029239:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1784935570.029240:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935570.029355:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273175808 00000040:00080000:1.0:1784935570.029359:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000100:00100000:2.0:1784935570.029367:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273175808 00000040:00080000:1.0:1784935570.029367:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784935570.029436:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 47 00000100:00100000:2.0:1784935570.029448:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+61:12316:x1871640273175808:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:2.0:1784935570.029693:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+62:12316:x1871640273175808:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 247us (463us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1784935570.029702:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 47 00000100:00100000:0.0:1784935570.089914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935570.089986:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935570.090023:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935570.090059:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935570.090085:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273175936 00000100:00100000:0.0:1784935570.090095:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273175936 00000100:00100000:2.0:1784935570.090143:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273176064 00000100:00100000:2.0:1784935570.090149:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273176064 00000100:00100000:0.0:1784935570.090158:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 383 00000100:00100000:0.0:1784935570.090170:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e02d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273175936:12345-192.168.203.28@tcp:400:kworker.0 00000100:00080000:2.0:1784935570.090201:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784935570.090238:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273176576 00000100:00100000:2.0:1784935570.090241:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273176576 00000100:00100000:0.0:1784935570.090257:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e02d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273175936:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 89us (195us total) trans 0 rc 0/0 00000100:00080000:2.0:1784935570.090259:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935570.090269:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 383 00000100:00100000:2.0:1784935570.090283:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 303 00000100:00100000:2.0:1784935570.090294:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273176064:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935570.090335:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273176064:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 43us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935570.090346:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 303 00000100:00100000:0.0:1784935570.090350:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935570.090365:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 304 00000100:00100000:2.0:1784935570.090372:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273176576:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935570.090395:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273176576:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 24us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935570.090412:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 304 00000100:00100000:0.0:1784935570.090420:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935570.090478:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273176320 00000100:00100000:3.0:1784935570.090483:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273176320 00000100:00100000:3.0:1784935570.090515:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273176192 00000100:00100000:3.0:1784935570.090517:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273176192 00000100:00100000:3.0:1784935570.090541:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 116 00000100:00100000:3.0:1784935570.090548:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2394:x1871640273176320:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935570.090578:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 117 00000100:00100000:3.0:1784935570.090586:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2394:x1871640273176320:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 37us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935570.090594:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273176192:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935570.090599:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 116 00000100:00100000:1.0:1784935570.090636:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2394:x1871640273176192:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 48us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935570.090657:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 117 00000100:00100000:2.0:1784935570.090746:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273176448 00000100:00100000:2.0:1784935570.090751:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273176448 00000100:00080000:2.0:1784935570.090761:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784935570.090764:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784935570.090779:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935570.090798:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 305 00000100:00100000:2.0:1784935570.090806:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273176448:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935570.092329:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273176448:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 1514us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935570.092341:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 305 00000100:00100000:3.0:1784935570.235111:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935570.235205:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273176832 00000100:00100000:0.0:1784935570.235214:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273176832 00000100:00100000:0.0:1784935570.235280:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 182 00000100:00100000:0.0:1784935570.235290:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+62:12334:x1871640273176832:12345-192.168.203.28@tcp:101:cat.0 00010000:00010000:0.0:1784935570.235313:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935570.235339:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b171a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abaf expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.235441:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.235466:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.235478:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935570.235490:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784935570.235592:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b171a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abaf expref: 65 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.235610:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abaf expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935570.235618:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:0.0:1784935570.235621:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784935570.235623:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698a00, rc 0) 00000100:00100000:0.0:1784935570.235683:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+64:12334:x1871640273176832:12345-192.168.203.28@tcp:101:cat.0 Request processed in 395us (582us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1784935570.235706:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 182 00000100:00100000:0.0:1784935570.283857:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935570.284016:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273176960 00000100:00100000:2.0:1784935570.284027:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273176960 00000100:00100000:2.0:1784935570.284090:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 183 00000100:00100000:2.0:1784935570.284100:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+64:12335:x1871640273176960:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935570.284125:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935570.284144:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abb6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.284216:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b171be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.284231:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b171be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.284242:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b171be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935570.284302:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784935570.284306:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935570.284324:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b171be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.284346:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abb6 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.284365:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b171be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abb6 expref: 65 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.284373:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:2.0:1784935570.284376:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784935570.284379:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200400, rc 0) 00000100:00100000:2.0:1784935570.284466:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12335:x1871640273176960:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 367us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935570.284473:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 183 00000100:00100000:1.0:1784935570.293141:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935570.296385:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273177344 00000100:00100000:2.0:1784935570.296475:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273177344 00000100:00100000:2.0:1784935570.296611:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 48 00000100:00100000:2.0:1784935570.296623:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12335:x1871640273177344:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:2.0:1784935570.296907:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12335:x1871640273177344:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 286us (3774us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1784935570.296914:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 48 00000100:00100000:1.0:1784935570.302962:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935570.303035:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273177472 00000100:00100000:3.0:1784935570.303044:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273177472 00000100:00100000:3.0:1784935570.303113:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00100000:3.0:1784935570.303124:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12335:x1871640273177472:12345-192.168.203.28@tcp:103:lfs.0 00010000:00010000:3.0:1784935570.303139:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784935570.303172:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1714e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab9a expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.303206:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abaf expref: 65 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.303241:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b1704b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab54 expref: 64 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935570.303252:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:3.0:1784935570.303256:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935570.303318:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+63:12335:x1871640273177472:12345-192.168.203.28@tcp:103:lfs.0 Request processed in 196us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935570.303325:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00100000:1.0:1784935570.305723:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935570.308298:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273177600 00000100:00100000:2.0:1784935570.308313:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273177600 00000100:00100000:2.0:1784935570.308395:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 184 00000100:00100000:2.0:1784935570.308415:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+63:12335:x1871640273177600:12345-192.168.203.28@tcp:58:lfs.0 00010000:00010000:2.0:1784935570.308534:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171c5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.308552:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.308563:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784935570.308661:0:7797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1784935570.308749:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+63:12335:x1871640273177600:12345-192.168.203.28@tcp:58:lfs.0 Request processed in 335us (3033us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935570.308756:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 184 00000100:00100000:0.0:1784935570.338017:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935570.338111:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273177728 00000100:00100000:2.0:1784935570.338121:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273177728 00000100:00100000:2.0:1784935570.338179:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 185 00000100:00100000:2.0:1784935570.338196:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+63:12337:x1871640273177728:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935570.338215:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935570.338235:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b171cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abbd expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338292:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b171d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338305:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b171d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338314:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b171d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338336:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b171da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338344:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b171da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338350:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b171da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338420:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338435:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338442:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935570.338479:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784935570.338482:0:12375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935570.338498:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338508:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338516:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b171d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338523:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b171d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338538:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b171d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338544:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935570.338548:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b171d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338555:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b171d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338566:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:2.0:1784935570.338569:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935570.338573:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b171d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338579:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b171d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338590:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b171da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338595:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b171da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338601:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b171da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338606:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935570.338608:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b171da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338622:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b171da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338629:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44429bbd00) 00010000:00010000:2.0:1784935570.338631:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935570.338634:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b171da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338639:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b171da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338661:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b171cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abbd expref: 65 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338672:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abbd expref: 64 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935570.338679:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:2.0:1784935570.338681:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784935570.338682:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200000, rc 0) 00000100:00100000:2.0:1784935570.338738:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+64:12337:x1871640273177728:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 552us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935570.338745:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 185 00000100:00100000:1.0:1784935570.349272:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292106880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784935570.349348:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935570.349731:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292106880 00000100:00100000:3.0:1784935570.349739:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292106880 00000100:00100000:3.0:1784935570.349791:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784935570.349800:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292106880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784935570.349832:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784935570.349890:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292106880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935570.349898:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1784935570.349985:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292106880:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1784935570.415862:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784935570.542330:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784935571.055431:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935571.055441:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784935571.055465:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784935571.055474:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784935571.055600:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d6ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292107008:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784935571.055685:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70c00 going to sleep for 11 seconds 00000040:00080000:2.0:1784935571.076709:0:14659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784935571.076785:0:14659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784935571.076953:0:14659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1784935571.076961:0:14659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784935571.084589:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935571.084604:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d6ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292107008:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784935571.084713:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273177856 00000100:00100000:0.0:1784935571.084720:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273177856 00000100:00100000:0.0:1784935571.084774:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 186 00000100:00100000:0.0:1784935571.084784:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+64:12349:x1871640273177856:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784935571.085913:0:6525:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784935571.086033:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+64:12349:x1871640273177856:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 1248us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935571.086040:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 186 00000100:00100000:0.0:1784935571.092238:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935571.092342:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273177984 00000100:00100000:1.0:1784935571.092351:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273177984 00000100:00100000:0.0:1784935571.092499:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 187 00000100:00100000:0.0:1784935571.092510:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+64:12349:x1871640273177984:12345-192.168.203.28@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784935571.092585:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b171e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092609:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b171e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092623:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b171e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092681:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b171ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092689:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b171ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092696:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b171ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092722:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092729:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092735:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935571.092779:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1784935571.092784:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935571.092796:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092807:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b171e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092829:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b171e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092836:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b171e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092842:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935571.092846:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b171e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092853:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b171e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092864:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:0.0:1784935571.092867:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935571.092871:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b171e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092877:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b171e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092889:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b171ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092895:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b171ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092901:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b171ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092906:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935571.092916:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b171ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092922:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b171ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092975:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8d45705a8800) 00010000:00010000:0.0:1784935571.092978:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935571.092981:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b171ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.092987:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b171ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.093000:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.093006:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.093012:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.093016:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935571.093019:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.093024:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.093031:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:0.0:1784935571.093033:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935571.093042:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.093048:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b171f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935571.093116:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+64:12349:x1871640273177984:12345-192.168.203.28@tcp:34:lhsmtool_posix.0 Request processed in 608us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935571.093124:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 187 00000100:00100000:0.0:1784935571.098444:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935571.100447:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273178240 00000100:00100000:1.0:1784935571.100459:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273178240 00000100:00100000:1.0:1784935571.100556:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 188 00000100:00100000:1.0:1784935571.100568:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+64:12349:x1871640273178240:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935571.100588:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935571.100609:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b171fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abc4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.100714:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17204 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.100730:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.100742:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935571.100754:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784935571.100851:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.100865:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17204 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.100872:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17204 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.100878:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.100883:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17204 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.100891:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17204 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.100903:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935571.100907:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784935571.100911:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17204 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.100918:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17204 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.100975:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b171fd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abc4 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.100987:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:1.0:1784935571.100990:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784935571.100994:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b171fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abc4 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.101003:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8000, rc 0) 00000100:00100000:1.0:1784935571.101076:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12349:x1871640273178240:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 511us (2641us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1784935571.101083:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 188 00000100:00100000:0.0:1784935571.110320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935571.110427:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273178368 00000100:00100000:2.0:1784935571.110443:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273178368 00000100:00100000:2.0:1784935571.110498:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 189 00000100:00100000:2.0:1784935571.110508:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12349:x1871640273178368:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784935571.110543:0:6525:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784935571.110653:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12349:x1871640273178368:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 146us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935571.110661:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 189 00000100:00100000:1.0:1784935571.124328:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935571.127783:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273178624 00000100:00100000:0.0:1784935571.127798:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273178624 00000100:00100000:0.0:1784935571.127863:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 190 00000100:00100000:0.0:1784935571.127872:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12349:x1871640273178624:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784935571.127893:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935571.127896:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784935571.127922:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200400/0x857e02f4e0b171be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abb6 expref: 65 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.127961:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:0.0:1784935571.127966:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784935571.127979:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b17212 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abcb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784935571.128333:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1784935571.128469:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17219 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.128496:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.128506:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.128559:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b17212 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abcb expref: 67 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.128575:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17219 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abcb expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.128582:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d45705a8800) 00010000:00010000:0.0:1784935571.128584:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935571.128587:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699000, rc 0) 00000100:00100000:0.0:1784935571.128660:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12349:x1871640273178624:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 788us (4341us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1784935571.128668:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 190 00000100:00100000:0.0:1784935571.134366:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935571.135374:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273178880 00000100:00100000:1.0:1784935571.135386:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273178880 00000100:00100000:1.0:1784935571.135520:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 191 00000100:00100000:1.0:1784935571.135531:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12349:x1871640273178880:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784935571.135588:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935571.135614:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b17219 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abcb expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135631:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d45705a8800) 00010000:00010000:1.0:1784935571.135641:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935571.135664:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17227 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135677:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17227 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135686:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17227 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135748:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b1722e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc7a50494 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135755:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b1722e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc7a50494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135761:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b1722e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc7a50494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135812:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17227 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135831:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17227 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135843:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17227 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135849:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.135852:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17227 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135859:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17227 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135867:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935571.135870:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935571.135874:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17227 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135879:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17227 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135888:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b1722e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc7a50494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135894:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b1722e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc7a50494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135903:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b1722e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc7a50494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135914:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.135918:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b1722e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc7a50494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135952:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b1722e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc7a50494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135965:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc7a50494 (ffff8d457d166200) 00010000:00010000:1.0:1784935571.135967:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935571.135970:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b1722e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc7a50494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.135976:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b1722e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc7a50494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935571.136067:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12349:x1871640273178880:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 538us (1710us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784935571.136075:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 191 00000100:00100000:1.0:1784935571.144110:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935571.145215:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273179008 00000100:00100000:3.0:1784935571.145227:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273179008 00000100:00100000:3.0:1784935571.145916:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 192 00000100:00100000:3.0:1784935571.145957:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12349:x1871640273179008:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784935571.145978:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935571.146000:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17235 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abd2 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.146032:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1723c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.146052:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1723c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.146064:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1723c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.146174:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17235 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd2 expref: 67 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.146201:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1723c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd2 expref: 66 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.146209:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:3.0:1784935571.146212:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784935571.146215:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020000, rc 0) 00000100:00100000:3.0:1784935571.146276:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12349:x1871640273179008:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 350us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935571.146283:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 192 00000100:00100000:1.0:1784935571.153428:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935571.153477:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273179264 00000100:00100000:0.0:1784935571.153487:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273179264 00000100:00100000:0.0:1784935571.153541:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 193 00000100:00100000:0.0:1784935571.153552:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12349:x1871640273179264:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784935571.153627:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.153644:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.153663:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784935571.153847:0:7797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1784935571.153856:0:7797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390403927966ns, next at 391403925571ns, rc = 0 00000004:00010000:0.0:1784935571.154064:0:7797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b380f85 reply state 00000000349bbeee transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.154078:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.154086:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:0.0:1784935571.154089:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784935571.154093:0:7797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784935571.154306:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+68:12349:x1871640273179264:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 743us (875us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1784935571.154316:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 193 00000100:00100000:0.0:1784935571.158128:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935571.159397:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273179392 00000100:00100000:3.0:1784935571.159409:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273179392 00000100:00100000:3.0:1784935571.159479:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 194 00000100:00100000:3.0:1784935571.159490:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+68:12349:x1871640273179392:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784935571.159515:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935571.159537:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1724a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abd9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.159595:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1724a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd9 expref: 69 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.159624:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1724a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd9 expref: 69 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.159643:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:3.0:1784935571.159646:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784935571.159650:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021600, rc 0) 00000100:00100000:3.0:1784935571.159704:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+69:12349:x1871640273179392:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 216us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935571.159711:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 194 00000100:00100000:1.0:1784935571.163062:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935571.165411:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273179520 00000100:00100000:3.0:1784935571.165423:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273179520 00000100:00100000:3.0:1784935571.165489:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 58 00000100:00100000:3.0:1784935571.165500:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+6:2392:x1871640273179520:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1784935571.165703:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273179520:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 Request processed in 204us (2652us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1784935571.165711:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 58 00000100:00100000:1.0:1784935571.168597:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935571.168777:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273179776 00000100:00100000:2.0:1784935571.168787:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273179776 00000100:00100000:2.0:1784935571.168856:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 49 00000100:00100000:2.0:1784935571.168866:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+69:12349:x1871640273179776:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784935571.169097:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+70:12349:x1871640273179776:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 232us (510us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1784935571.169105:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 49 00000100:00100000:2.0:1784935571.171436:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935571.171540:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273180032 00000100:00100000:3.0:1784935571.171549:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273180032 00000100:00100000:3.0:1784935571.171601:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 195 00000100:00100000:3.0:1784935571.171611:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+70:12349:x1871640273180032:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784935571.171715:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+70:12349:x1871640273180032:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 105us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935571.171722:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 195 00000100:00100000:3.0:1784935571.174006:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935571.174072:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273180160 00000100:00100000:0.0:1784935571.174083:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273180160 00000100:00100000:0.0:1784935571.174149:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 196 00000100:00100000:0.0:1784935571.174159:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+70:12349:x1871640273180160:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784935571.174190:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935571.174215:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b17251 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abe0 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.174301:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b17258 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.174327:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b17258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.174340:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b17258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935571.174383:0:7797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935571.174400:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b17258 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.174424:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b17251 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe0 expref: 72 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.174441:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b17258 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe0 expref: 71 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.174450:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:0.0:1784935571.174452:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784935571.174456:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699c00, rc 0) 00000100:00100000:0.0:1784935571.174517:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+71:12349:x1871640273180160:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 359us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935571.174524:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 196 00000100:00100000:2.0:1784935571.179786:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935571.179836:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273180288 00000100:00100000:3.0:1784935571.179846:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273180288 00000100:00100000:3.0:1784935571.179968:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 59 00000100:00100000:3.0:1784935571.179978:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273180288:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784935571.179995:0:8987:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935571.180016:0:8987:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1725f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abe7 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784935571.180038:0:8987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63f493, blocks: 0x0 00010000:00010000:3.0:1784935571.180057:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1784935571.180062:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935571.180071:0:8987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1725f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe7 expref: 8 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.180091:0:8987:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1725f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe7 expref: 8 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.180105:0:8987:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021200, rc 0) 00000100:00100000:3.0:1784935571.180160:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273180288:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 183us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935571.180168:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 59 00000100:00100000:1.0:1784935571.197374:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935571.197482:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273180544 00000100:00100000:0.0:1784935571.197494:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273180544 00000100:00100000:0.0:1784935571.197555:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 197 00000100:00100000:0.0:1784935571.197566:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+71:12349:x1871640273180544:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784935571.197674:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+71:12349:x1871640273180544:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 110us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935571.197698:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 197 00000100:00100000:3.0:1784935571.200292:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935571.200371:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273180672 00000100:00100000:0.0:1784935571.200380:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273180672 00000100:00100000:0.0:1784935571.200438:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 60 00000100:00100000:0.0:1784935571.200447:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+8:12349:x1871640273180672:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784935571.200467:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935571.200486:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abee expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.200516:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1725f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe7 expref: 9 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.200524:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935571.200528:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935571.200533:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.200562:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1725f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe7 expref: 9 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.200573:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1725f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe7 expref: 9 pid: 8987 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935571.200586:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1871640292107136:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935571.200663:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784935571.202470:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1871640292107136:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935571.202499:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.202535:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698e00, rc 0) 00000100:00100000:3.0:1784935571.202589:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+9:12349:x1871640273180672:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 2143us (2307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935571.202598:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 60 00000100:00100000:2.0:1784935571.207216:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935571.207343:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273180800 00000100:00100000:0.0:1784935571.207353:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273180800 00010000:00010000:0.0:1784935571.207395:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1725f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe7 expref: 9 pid: 8987 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935571.207435:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 86 00000100:00100000:0.0:1784935571.207446:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2392:x1871640273180800:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935571.207461:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935571.207482:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1725f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe7 expref: 9 pid: 8987 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.207497:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1725f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe7 expref: 9 pid: 8987 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.207519:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1725f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe7 expref: 9 pid: 8987 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.207536:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935571.207541:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935571.207548:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.207557:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.207604:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935571.207627:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6510:1871640292107264:192.168.203.28@tcp:105: 00000100:00100000:0.0:1784935571.207705:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784935571.219444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935571.219533:0:8444:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273180928 00000100:00100000:2.0:1784935571.219543:0:8444:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273180928 00002000:00100000:2.0:1784935571.219590:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8d4443d35f80 x1871640273180928/t0(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:67/0 lens 504/0 e 0 to 0 dl 1784935582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784935571.219602:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443d35f80 with x1871640273180928 ext(0->8) 00002000:00010000:2.0:1784935571.219608:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443d35f80 00000100:00100000:2.0:1784935571.219641:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 4 00000100:00100000:2.0:1784935571.219651:0:8444:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2392:x1871640273180928:12345-192.168.203.28@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1784935571.225963:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6510:1871640292107264:192.168.203.28@tcp:105: 00010000:00010000:1.0:1784935571.225990:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935571.226047:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+11:2392:x1871640273180800:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 18601us (18839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935571.226068:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 86 00000100:00100000:2.0:1784935571.228780:0:8444:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+10:2392:x1871640273180928:12345-192.168.203.28@tcp:4:lhsmtool_posix.0 Request processed in 9122us (9337us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1784935571.228791:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 4 00002000:00100000:2.0:1784935571.228802:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8d4443d35f80 x1871640273180928/t4294967315(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:67/0 lens 504/448 e 0 to 0 dl 1784935582 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784935571.228810:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443d35f80 with x1871640273180928 ext(0->8) 00002000:00010000:2.0:1784935571.228815:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443d35f80 00000100:00100000:1.0:1784935571.234136:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935571.234207:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273181056 00000100:00100000:1.0:1784935571.234217:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273181056 00000100:00100000:1.0:1784935571.234275:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 198 00000100:00100000:1.0:1784935571.234286:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+71:12349:x1871640273181056:12345-192.168.203.28@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784935571.240372:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1784935571.241636:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1784935571.241700:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1784935571.241719:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d4442a70840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1784935571.241724:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d4442a5ec00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d4442a70180 00000020:00080000:1.0:1784935571.241727:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d4442a5e300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d444363e600 00010000:00010000:1.0:1784935571.241786:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241799:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241806:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241814:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.241819:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241828:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241858:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d44429bb000) 00010000:00010000:1.0:1784935571.241862:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935571.241867:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241873:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b16f8e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241892:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241897:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241902:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241907:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.241910:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241915:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241923:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935571.241947:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935571.241951:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241958:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201c00/0x857e02f4e0b16f95 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241987:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241993:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.241998:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242003:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.242006:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242012:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242021:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44429bbd00) 00010000:00010000:1.0:1784935571.242023:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935571.242026:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242031:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b16fd4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242046:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242053:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242058:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242070:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.242073:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242079:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242088:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935571.242090:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935571.242093:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242099:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b170d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242113:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242119:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242125:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242130:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.242133:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242138:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242159:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935571.242161:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935571.242164:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242170:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b170fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242198:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242205:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242211:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242217:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.242220:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242226:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242235:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935571.242237:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935571.242240:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242246:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17140 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242270:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242277:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242283:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242288:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.242292:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242298:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242306:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:1.0:1784935571.242309:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784935571.242312:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.242318:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b17243 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784935571.242451:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1784935571.242504:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1784935571.243001:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292107392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784935571.243067:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935571.243115:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935571.243121:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292107520:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784935571.243144:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935571.243256:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292107392 00000100:00100000:2.0:1784935571.243264:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292107392 00000100:00100000:2.0:1784935571.243309:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292107520 00000100:00100000:2.0:1784935571.243313:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292107520 00000100:00100000:2.0:1784935571.243336:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784935571.243343:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292107392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784935571.243405:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+19:12349:x1871640273181056:12345-192.168.203.28@tcp:44:lhsmtool_posix.0 Request processed in 9118us (9274us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935571.243413:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 198 00002000:00010000:2.0:1784935571.243438:0:8987:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784935571.243441:0:8987:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784935571 00002000:00010000:2.0:1784935571.243444:0:8987:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784935571.243446:0:8987:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784935571 -> 1784935571 00002000:00010000:2.0:1784935571.243448:0:8987:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1784935571.243488:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292107392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (421us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1784935571.243505:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784935571.243520:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784935571.243526:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292107520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784935571.243539:0:8987:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1784935571.243563:0:8987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a63f490, atime: 0x6a63f490, ctime: 0x6a63f490, blocks: 0x8 00010000:00010000:2.0:1784935571.243571:0:8987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1726d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.243597:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1784935571.243603:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935571.243609:0:8987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1726d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.243625:0:8987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1726d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.243634:0:8987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1726d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.243640:0:8987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1726d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.243657:0:8987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784935571.243751:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1871640292107520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 225us (605us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784935571.243757:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1784935571.243781:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784935571.243785:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784935571.243798:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935571.243804:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1726d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.243812:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935571.243816:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1726d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.243825:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1726d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.243841:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1726d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.243847:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056d46111/0x857e02f4e0b1726d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.243863:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935571.243865:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935571.243866:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784935571.244040:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d4443d9b800/2, rc 0, transno 4294967308 00000100:00100000:0.0:1784935571.244047:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292107520:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1784935571.244109:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d4443d98700/2, rc 0, transno 4294967316 00000100:00100000:0.0:1784935571.244113:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292107392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784935571.263581:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935571.263997:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273181184 00000100:00100000:0.0:1784935571.264008:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273181184 00000100:00100000:0.0:1784935571.264071:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 63 00000100:00100000:0.0:1784935571.264082:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+10:2391:x1871640273181184:12345-192.168.203.28@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1784935571.274125:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1784935571.274143:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1784935571.276459:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273181184:12345-192.168.203.28@tcp:16:lhsmtool_posix.0 Request processed in 12368us (12877us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935571.276475:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 63 00000100:00100000:1.0:1784935571.280786:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935571.280875:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273181440 00000100:00100000:0.0:1784935571.280885:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273181440 00000100:00100000:0.0:1784935571.280974:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 199 00000100:00100000:0.0:1784935571.280984:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+19:12349:x1871640273181440:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784935571.281035:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935571.281063:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b17258 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abe0 expref: 19 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.281081:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:0.0:1784935571.281092:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784935571.281118:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.281131:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.281142:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784935571.281280:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d124545 reply state 0000000013a3c044 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.281293:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.281300:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:0.0:1784935571.281302:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784935571.281305:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784935571.281405:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+20:12349:x1871640273181440:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 422us (631us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1784935571.281413:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 199 00000100:00100000:0.0:1784935571.287589:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935571.287665:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273181568 00000100:00100000:2.0:1784935571.287675:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273181568 00000100:00100000:2.0:1784935571.287732:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 64 00000100:00100000:2.0:1784935571.287741:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273181568:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784935571.287911:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1784935571.287915:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1784935571 -> 1784935570 00002000:00010000:2.0:1784935571.287918:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1784935568 00002000:00010000:2.0:1784935571.287920:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784935571 -> 1784935570 00002000:00010000:2.0:1784935571.287922:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1784935571.288021:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273181568:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 Request processed in 280us (440us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1784935571.288028:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 64 00000100:00100000:2.0:1784935571.291146:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935571.291230:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273181824 00000100:00100000:1.0:1784935571.291241:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273181824 00000100:00100000:1.0:1784935571.291303:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 200 00000100:00100000:1.0:1784935571.291313:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44433d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+20:12349:x1871640273181824:12345-192.168.203.28@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1784935571.291380:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.291398:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1723c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd2 expref: 20 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.291408:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.291441:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1723c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd2 expref: 20 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.291455:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1723c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd2 expref: 20 pid: 12375 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935571.291468:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292107648:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935571.291554:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935571.297291:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935571.297419:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273181952 00000100:00100000:2.0:1784935571.297429:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273181952 00010000:00010000:2.0:1784935571.297472:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1723c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd2 expref: 21 pid: 12375 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935571.297519:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 87 00000100:00100000:2.0:1784935571.297530:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566e69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+21:2392:x1871640273181952:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935571.297551:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935571.297558:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1723c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd2 expref: 21 pid: 12375 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.297573:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1723c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd2 expref: 21 pid: 12375 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.297600:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:2.0:1784935571.297606:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.297635:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.297643:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.297664:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935571.297717:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566e69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+21:2392:x1871640273181952:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 189us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935571.297725:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 87 00010000:00010000:1.0:1784935571.298242:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b1723c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd2 expref: 20 pid: 12375 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935571.298319:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292107648:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935571.298340:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.298360:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.298366:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.298404:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.298411:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.298418:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.298424:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.298427:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.298433:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.298445:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:1.0:1784935571.298448:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784935571.298452:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.298458:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b1727b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935571.298588:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44433d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+19:12349:x1871640273181824:12345-192.168.203.28@tcp:55:lhsmtool_posix.0 Request processed in 7277us (7453us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784935571.298603:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 200 00000100:00100000:0.0:1784935571.300438:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935571.300533:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273182080 00000100:00100000:1.0:1784935571.300543:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273182080 00000100:00100000:1.0:1784935571.300634:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 65 00000100:00100000:1.0:1784935571.300644:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2392:x1871640273182080:12345-192.168.203.28@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784935571.300693:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.300715:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.300724:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935571.300729:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784935571.300733:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.300769:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.300784:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 8 pid: 8440 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935571.300799:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d98e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1871640292107776:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935571.300911:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935571.304050:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d98e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1871640292107776:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935571.304094:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935571.304805:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935571.305221:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273182208 00000100:00100000:2.0:1784935571.305230:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273182208 00010000:00010000:2.0:1784935571.305266:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 9 pid: 8440 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935571.305307:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 88 00000100:00100000:2.0:1784935571.305317:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2391:x1871640273182208:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935571.305332:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935571.305353:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 9 pid: 8440 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.305367:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 9 pid: 8440 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.305389:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c17ed8c/0x857e02f4e0b17266 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abee expref: 9 pid: 8440 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.305428:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784935571.305432:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784935571.305437:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.305447:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.305479:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784935571.305506:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.305519:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935571.305535:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273182208:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 218us (732us total) trans 0 rc 0/0 00010000:00010000:3.0:1784935571.305542:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935571.305542:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 88 00010000:00010000:3.0:1784935571.305554:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.305562:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.305569:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935571.305573:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.305582:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.305602:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.305610:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009019d3da/0x857e02f4e0b17282 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935571.305654:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273182080:12345-192.168.203.28@tcp:1:lhsmtool_posix.0 Request processed in 5012us (5224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935571.305662:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 65 00000100:00100000:2.0:1784935571.307834:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935571.308010:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273182464 00000100:00100000:0.0:1784935571.308019:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273182464 00000100:00100000:1.0:1784935571.308592:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 201 00000100:00100000:1.0:1784935571.308604:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+19:12349:x1871640273182464:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784935571.308680:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.308697:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b170d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab77 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.308707:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.308741:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b170d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab77 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.308756:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b170d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab77 expref: 19 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935571.308779:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292107904:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935571.308865:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935571.310642:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292107904:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935571.310667:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935571.311597:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935571.311639:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273182592 00000100:00100000:3.0:1784935571.311647:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273182592 00010000:00010000:3.0:1784935571.311676:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b170d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab77 expref: 20 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935571.311707:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 89 00000100:00100000:3.0:1784935571.311715:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+20:2392:x1871640273182592:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935571.311728:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935571.311735:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b170d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab77 expref: 20 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.311750:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b170d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab77 expref: 20 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.311772:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b170d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab77 expref: 20 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.311805:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:3.0:1784935571.311809:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.311829:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.311836:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.311868:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935571.311918:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+19:2392:x1871640273182592:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 203us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935571.311956:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 89 00010000:00010000:1.0:1784935571.312079:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.312094:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.312277:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.312289:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1724a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd9 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.312297:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.312326:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1724a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd9 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.312339:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1724a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd9 expref: 19 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935571.312353:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292108032:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935571.312421:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784935571.314984:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292108032:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935571.315014:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935571.315162:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935571.315222:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273182720 00000100:00100000:1.0:1784935571.315229:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273182720 00010000:00010000:1.0:1784935571.315262:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1724a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd9 expref: 20 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935571.315325:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 90 00000100:00100000:1.0:1784935571.315337:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+20:2391:x1871640273182720:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935571.315352:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935571.315359:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1724a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd9 expref: 20 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.315371:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1724a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd9 expref: 20 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.315391:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1724a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abd9 expref: 20 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.315407:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:1.0:1784935571.315412:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.315425:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.315432:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.315508:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935571.315561:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+19:2391:x1871640273182720:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 227us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935571.315569:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 90 00010000:00010000:2.0:1784935571.315670:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.315679:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784935571.315783:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1784935571.316629:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1784935571.316682:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1784935571.316764:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d44435a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6525:1871640292108160:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784935571.317019:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935571.317049:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45491539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935571.317131:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292108160 00000100:00100000:1.0:1784935571.317144:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292108160 00000100:00100000:1.0:1784935571.317236:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784935571.317245:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1871640292108160:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784935571.317333:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1871640292108160:12345-0@lo:1000:mdt00_000.0 Request processed in 89us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935571.317349:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784935571.317406:0:6525:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1784935571.317412:0:6525:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d4443d98700, transno 4294967316 00000100:00100000:2.0:1784935571.317427:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d44435a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6525:1871640292108160:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1784935571.317540:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1784935571.317579:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6525:1871640292108288:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784935571.317616:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935571.318094:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549153600 going to sleep for 11 seconds 00000100:00100000:3.0:1784935571.318383:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292108288 00000100:00100000:3.0:1784935571.318390:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292108288 00000100:00100000:3.0:1784935571.318421:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1784935571.318427:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1871640292108288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784935571.318669:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6525:x1871640292108288:12345-0@lo:1000:mdt00_000.0 Request processed in 241us (1052us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1784935571.318676:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784935571.318763:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6525:1871640292108288:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1784935571.318804:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.318813:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.318874:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.318881:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935571.318885:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.318892:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.318906:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:2.0:1784935571.318909:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784935571.318913:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.318920:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17290 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319048:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319055:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171c5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319061:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319067:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935571.319070:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319076:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171c5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319083:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:2.0:1784935571.319086:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784935571.319089:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171c5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319094:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201600/0x857e02f4e0b171c5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319116:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319129:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abbd expref: 22 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319138:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319172:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abbd expref: 22 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935571.319198:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abbd expref: 22 pid: 12375 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935571.319210:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292108416:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935571.319309:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44421fc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935571.321598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935571.321678:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292108416:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935571.321678:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273182848 00000100:00100000:0.0:1784935571.321687:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273182848 00010000:00010000:1.0:1784935571.321702:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.321731:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abbd expref: 23 pid: 12375 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935571.321792:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 91 00000100:00100000:0.0:1784935571.321803:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+23:2392:x1871640273182848:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935571.321817:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935571.321824:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abbd expref: 23 pid: 12375 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.321836:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abbd expref: 23 pid: 12375 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.321857:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b171e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abbd expref: 23 pid: 12375 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.321872:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:0.0:1784935571.321877:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.321885:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.321892:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.321918:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935571.321994:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935571.321996:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+22:2392:x1871640273182848:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 194us (405us total) trans 0 rc 0/0 00010000:00010000:1.0:1784935571.322011:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935571.322012:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 91 00010000:00010000:1.0:1784935571.322029:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322036:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322044:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322050:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.322054:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322062:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322089:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935571.322092:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935571.322096:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322101:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b17297 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322112:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322119:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322125:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322130:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935571.322132:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322139:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322146:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44429bba00) 00010000:00010000:1.0:1784935571.322149:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784935571.322151:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935571.322156:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17289 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935571.322313:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d32ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+21:12349:x1871640273182464:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 13710us (14486us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1784935571.322322:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 201 00000020:00080000:1.0:1784935571.322325:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784935571.322592:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935571.322604:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784935571.323346:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1784935571.323359:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784935571.325529:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935571.325856:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273183104 00000100:00100000:0.0:1784935571.325867:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273183104 00000100:00100000:0.0:1784935571.325922:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:0.0:1784935571.325958:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a0b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+21:12349:x1871640273183104:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784935571.326468:0:6529:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784935571.326499:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1784935571.326533:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b1729e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.326549:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b1729e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.326560:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b1729e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.326569:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b1729e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.326576:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b1729e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.326583:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b1729e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935571.326607:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935571.326640:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935571.326648:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b1729e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.326657:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935571.326662:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b1729e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.326683:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b1729e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935571.326698:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a0b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+23:12349:x1871640273183104:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 739us (1175us total) trans 4294967470 rc 0/0 00010000:00010000:3.0:1784935571.326699:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:3.0:1784935571.326705:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784935571.326710:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b1729e lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935571.326721:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b1729e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935571.326726:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 50 00010000:00010000:3.0:1784935571.326737:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935571.326741:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784935571.326741:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784935571.326746:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935571.565365:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935572.589240:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784935572.745216:0:14711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935572.745225:0:14711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784935572.745265:0:14711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784935572.745273:0:14711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784935572.850786:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935572.850860:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273183360 00000100:00100000:1.0:1784935572.850869:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273183360 00000100:00100000:1.0:1784935572.850950:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 202 00000100:00100000:1.0:1784935572.850960:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+23:12367:x1871640273183360:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:1.0:1784935572.850982:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935572.851000:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abf5 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.851096:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b172ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.851110:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b172ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.851124:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b172ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935572.851136:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1784935572.851241:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abf5 expref: 26 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784935572.851345:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784935572.851599:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b172ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abf5 expref: 25 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.851624:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935572.851627:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784935572.851630:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9400, rc 0) 00000100:00100000:1.0:1784935572.851716:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+25:12367:x1871640273183360:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 758us (937us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1784935572.851723:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 202 00000100:00100000:2.0:1784935572.857392:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935572.857483:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273183488 00000100:00100000:1.0:1784935572.857494:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273183488 00000100:00100000:1.0:1784935572.857575:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 203 00000100:00100000:1.0:1784935572.857584:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+25:12367:x1871640273183488:12345-192.168.203.28@tcp:34:lfs.0 00010000:00010000:1.0:1784935572.857657:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857674:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857686:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857701:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857709:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857716:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857794:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857803:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857809:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784935572.857849:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857861:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857867:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857874:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857880:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935572.857884:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857890:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857901:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935572.857904:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935572.857908:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.857919:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861226:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861243:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861250:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861256:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935572.861261:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861268:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861284:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44431e0100) 00010000:00010000:1.0:1784935572.861287:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935572.861291:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861298:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861318:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861325:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861337:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861342:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935572.861345:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861351:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861359:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0c00) 00010000:00010000:1.0:1784935572.861362:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935572.861365:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.861370:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935572.861467:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+25:12367:x1871640273183488:12345-192.168.203.28@tcp:34:lfs.0 Request processed in 3880us (4077us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935572.861477:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 203 00000100:00100000:1.0:1784935572.909210:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935572.909245:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292108544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784935572.909310:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935572.909580:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292108544 00000100:00100000:3.0:1784935572.909587:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292108544 00000100:00100000:3.0:1784935572.909642:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784935572.909652:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292108544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784935572.909683:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1784935572.909740:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292108544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935572.909747:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784935572.910080:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292108544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935572.916448:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935572.916542:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273183744 00000100:00100000:1.0:1784935572.916553:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273183744 00000100:00100000:1.0:1784935572.916614:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 204 00000100:00100000:1.0:1784935572.916624:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+25:12370:x1871640273183744:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:1.0:1784935572.916645:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935572.916679:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313abfc expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.916753:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.916766:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.916777:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.916802:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.916810:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.916816:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917019:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917028:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917036:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935572.917046:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1784935572.917126:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917145:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917151:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917158:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935572.917162:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917178:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917189:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935572.917192:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935572.917196:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917203:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b172d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917216:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917222:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917228:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917233:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935572.917242:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917248:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917256:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44431e0c00) 00010000:00010000:1.0:1784935572.917259:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935572.917261:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917267:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b172dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917305:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abfc expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917319:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abfc expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.917327:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:1.0:1784935572.917329:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935572.917332:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9200, rc 0) 00000100:00100000:1.0:1784935572.919743:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+27:12370:x1871640273183744:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 3109us (3292us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1784935572.919755:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 204 00000100:00100000:2.0:1784935572.926736:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935572.927080:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273183872 00000100:00100000:0.0:1784935572.927090:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273183872 00000100:00100000:3.0:1784935572.927249:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 205 00000100:00100000:3.0:1784935572.927262:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+27:12370:x1871640273183872:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:3.0:1784935572.927341:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b172f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.927386:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b172f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.927397:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b172f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.927431:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b172f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.927438:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b172f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.927444:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b172f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.927450:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935572.927454:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b172f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.927460:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b172f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.927470:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:3.0:1784935572.927473:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784935572.927478:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b172f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.927483:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b172f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935572.927559:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+27:12370:x1871640273183872:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 300us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935572.927572:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 205 00000100:00100000:2.0:1784935572.933044:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935572.933514:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273184128 00000100:00100000:1.0:1784935572.933524:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273184128 00000100:00100000:1.0:1784935572.933594:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00100000:1.0:1784935572.933603:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+27:12370:x1871640273184128:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:1.0:1784935572.933856:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+28:12370:x1871640273184128:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 253us (819us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1784935572.933863:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00100000:2.0:1784935572.970652:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935572.970863:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273184384 00000100:00100000:1.0:1784935572.970873:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273184384 00000100:00100000:1.0:1784935572.971004:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 206 00000100:00100000:1.0:1784935572.971016:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+28:11894:x1871640273184384:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935572.971041:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935572.971062:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac03 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.971312:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.971324:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abfc expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.971330:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.971358:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abfc expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.971371:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abfc expref: 29 pid: 6525 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935572.971384:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292108672:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935572.971631:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455199fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935572.974001:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292108672:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935572.974026:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935572.974508:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935572.974565:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273184512 00000100:00100000:0.0:1784935572.974573:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273184512 00010000:00010000:0.0:1784935572.974612:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abfc expref: 30 pid: 6525 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935572.974689:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 92 00000100:00100000:0.0:1784935572.974699:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+30:2392:x1871640273184512:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935572.974713:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935572.974720:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abfc expref: 30 pid: 6525 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935572.974731:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abfc expref: 30 pid: 6525 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935572.974750:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b172e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313abfc expref: 30 pid: 6525 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935572.974764:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:0.0:1784935572.974769:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935572.974803:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935572.974811:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935572.974848:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935572.974899:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+29:2392:x1871640273184512:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 201us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935572.974906:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 92 00010000:00010000:3.0:1784935572.975067:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.975075:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935572.975094:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1784935572.975238:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b172f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac03 expref: 30 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.975305:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac03 expref: 29 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.975314:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:3.0:1784935572.975316:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784935572.975319:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8000, rc 0) 00000100:00100000:3.0:1784935572.975358:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+29:11894:x1871640273184384:12345-192.168.203.28@tcp:101:bash.0 Request processed in 4344us (4714us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1784935572.975364:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 206 00000100:00100000:2.0:1784935572.978749:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935572.978881:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273184640 00000100:00100000:1.0:1784935572.978890:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273184640 00000100:00100000:1.0:1784935572.978968:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 207 00000100:00100000:1.0:1784935572.978978:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+29:11894:x1871640273184640:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935572.979000:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935572.979017:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b1730e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac0a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.979052:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17315 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.979067:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17315 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.979077:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17315 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.979186:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b1730e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac0a expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.979202:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17315 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac0a expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935572.979210:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:1.0:1784935572.979226:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784935572.979229:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9800, rc 0) 00000100:00100000:1.0:1784935572.979279:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+30:11894:x1871640273184640:12345-192.168.203.28@tcp:101:bash.0 Request processed in 303us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935572.979286:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 207 00000100:00100000:2.0:1784935572.990444:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935572.990545:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273184896 00000100:00100000:0.0:1784935572.990555:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273184896 00000100:00100000:0.0:1784935572.990619:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 208 00000100:00100000:0.0:1784935572.990630:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+30:11894:x1871640273184896:12345-192.168.203.28@tcp:36:bash.0 00010000:00010000:0.0:1784935572.990845:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935572.990862:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935572.990873:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784935572.990913:0:12375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1784935572.990970:0:12375:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000624b988d reply state 000000006e0ee8c1 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935572.990993:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935572.991018:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:0.0:1784935572.991020:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784935572.991024:0:12375:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1784935572.991064:0:12375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1784935572.991178:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+34:11894:x1871640273184896:12345-192.168.203.28@tcp:36:bash.0 Request processed in 541us (733us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1784935572.991186:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 208 00000020:00080000:0.0:1784935572.991190:0:12375:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1784935572.994147:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935572.994246:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273185024 00000100:00100000:3.0:1784935572.994255:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273185024 00000100:00100000:3.0:1784935572.994309:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 209 00000100:00100000:3.0:1784935572.994319:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+34:11894:x1871640273185024:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:3.0:1784935572.994341:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935572.994370:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17323 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac11 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.994445:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17323 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac11 expref: 35 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.994460:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17323 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac11 expref: 35 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.994477:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:3.0:1784935572.994480:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784935572.994484:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021800, rc 0) 00000100:00100000:3.0:1784935572.994537:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+35:11894:x1871640273185024:12345-192.168.203.28@tcp:101:bash.0 Request processed in 219us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935572.994543:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 209 00000100:00100000:2.0:1784935572.999497:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935572.999575:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273185152 00000100:00100000:3.0:1784935572.999584:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273185152 00000100:00080000:2.0:1784935572.999682:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935572.999747:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 66 00000100:00100000:3.0:1784935572.999756:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:11894:x1871640273185152:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:3.0:1784935572.999771:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935572.999791:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070594ba8/0x857e02f4e0b1732a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac18 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784935572.999814:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a63f492, atime: 0x6a63f490, ctime: 0x6a63f492, blocks: 0x8 00010000:00010000:3.0:1784935572.999842:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=392s v=(0 0) 00010000:00010000:3.0:1784935572.999847:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935572.999855:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070594ba8/0x857e02f4e0b1732a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac18 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.999889:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070594ba8/0x857e02f4e0b1732a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac18 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935572.999902:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020c00, rc 0) 00000100:00100000:3.0:1784935573.000031:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+8:11894:x1871640273185152:12345-192.168.203.28@tcp:101:bash.0 Request processed in 275us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935573.000038:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 66 00000100:00100000:2.0:1784935573.002325:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.002496:0:8446:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273185280 00000100:00100000:0.0:1784935573.002505:0:8446:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273185280 00002000:00010000:0.0:1784935573.002545:0:8446:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1784935573.002550:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443dad180 with x1871640273185280 ext(0->18446744073709551615) 00002000:00010000:0.0:1784935573.002562:0:8446:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443dad180. 00000100:00100000:0.0:1784935573.002655:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 5 00000100:00100000:0.0:1784935573.002664:0:8446:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2394:x1871640273185280:12345-192.168.203.28@tcp:10:bash.0 00002000:00010000:0.0:1784935573.002883:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1784935573.002887:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1784935570 -> 1784935573 00002000:00010000:0.0:1784935573.002889:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1784935568 -> 1784935568 00002000:00010000:0.0:1784935573.002892:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784935570 -> 1784935573 00002000:00010000:0.0:1784935573.002894:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1784935573.002971:0:8446:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2394:x1871640273185280:12345-192.168.203.28@tcp:10:bash.0 Request processed in 307us (653us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1784935573.003425:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 5 00002000:00010000:0.0:1784935573.003430:0:8446:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1784935573.003432:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443dad180 with x1871640273185280 ext(0->18446744073709551615) 00002000:00010000:0.0:1784935573.003437:0:8446:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443dad180. 00000100:00100000:2.0:1784935573.094347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935573.094448:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273185408 00000100:00100000:3.0:1784935573.094466:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273185408 00000100:00100000:3.0:1784935573.094529:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 210 00000100:00100000:3.0:1784935573.094539:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+35:12384:x1871640273185408:12345-192.168.203.28@tcp:34:lfs.0 00010000:00010000:3.0:1784935573.094626:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17331 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094642:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17331 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094653:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17331 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094670:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17338 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094676:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17338 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094683:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17338 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094763:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1733f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094773:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1733f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094780:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1733f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784935573.094822:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1733f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094833:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17331 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094841:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17331 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094848:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17331 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094855:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935573.094859:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17331 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094866:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17331 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094877:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:3.0:1784935573.094881:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935573.094885:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17331 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094897:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b17331 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094912:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17338 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094918:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17338 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094923:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17338 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094977:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935573.094981:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17338 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094987:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17338 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.094995:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44434a7100) 00010000:00010000:3.0:1784935573.094998:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935573.095000:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17338 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.095006:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17338 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.095019:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1733f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.095025:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1733f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.095036:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1733f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.095041:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935573.095044:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1733f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.095049:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1733f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.095057:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:3.0:1784935573.095060:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935573.095062:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1733f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.095068:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021a00/0x857e02f4e0b1733f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935573.095149:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+35:12384:x1871640273185408:12345-192.168.203.28@tcp:34:lfs.0 Request processed in 611us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935573.095158:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 210 00000100:00100000:2.0:1784935573.143823:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.144673:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273185664 00000100:00100000:1.0:1784935573.144683:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273185664 00000100:00100000:1.0:1784935573.144831:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 211 00000100:00100000:1.0:1784935573.144842:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+35:12387:x1871640273185664:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:1.0:1784935573.144862:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935573.144882:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17346 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac1f expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.144965:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1734d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.144980:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1734d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.144991:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1734d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145004:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17354 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145011:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145018:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145125:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1735b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145145:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1735b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145153:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1735b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935573.145162:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784935573.145242:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1734d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145248:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1734d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145254:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1734d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145260:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935573.145264:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1734d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145270:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1734d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145280:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935573.145282:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935573.145287:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1734d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145314:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b1734d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145328:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145334:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17354 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145339:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17354 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145345:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935573.145348:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17354 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145354:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17354 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145362:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44431e0c00) 00010000:00010000:1.0:1784935573.145365:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935573.145368:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17354 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145373:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17354 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145408:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17346 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac1f expref: 38 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145421:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1735b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac1f expref: 37 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.145434:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:1.0:1784935573.145437:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784935573.145439:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9000, rc 0) 00000100:00100000:1.0:1784935573.145511:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+37:12387:x1871640273185664:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 671us (1696us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1784935573.145519:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 211 00000100:00100000:2.0:1784935573.150881:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.150997:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273185792 00000100:00100000:1.0:1784935573.151018:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273185792 00000100:00100000:1.0:1784935573.151075:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 212 00000100:00100000:1.0:1784935573.151085:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44435a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+37:12387:x1871640273185792:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:1.0:1784935573.151180:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.151198:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac03 expref: 37 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.151207:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.151240:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac03 expref: 37 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.151254:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac03 expref: 37 pid: 6527 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.151268:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292108800:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935573.151381:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455199fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935573.154795:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.154907:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273186048 00000100:00100000:0.0:1784935573.154919:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273186048 00000100:00100000:1.0:1784935573.154970:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1871640292108800:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935573.154999:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935573.155012:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 52 00000100:00100000:0.0:1784935573.155024:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+38:6160:x1871640273186048:12345-192.168.203.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784935573.155814:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+39:6160:x1871640273186048:12345-192.168.203.28@tcp:35:ldlm_bl.0 Request processed in 788us (1033us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1784935573.155825:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 52 00000100:00100000:2.0:1784935573.160515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935573.160746:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273186176 00000100:00100000:3.0:1784935573.160756:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273186176 00010000:00010000:3.0:1784935573.160797:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac03 expref: 39 pid: 6527 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935573.160836:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 93 00000100:00100000:3.0:1784935573.160846:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+39:2392:x1871640273186176:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935573.160860:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935573.160880:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac03 expref: 39 pid: 6527 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.160893:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac03 expref: 39 pid: 6527 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.160912:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17300 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac03 expref: 39 pid: 6527 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.160970:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:3.0:1784935573.160976:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.160987:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.161003:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.161028:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935573.161052:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.161062:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935573.161080:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+38:2392:x1871640273186176:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 235us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935573.161089:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 93 00010000:00010000:1.0:1784935573.161099:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.161107:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.161114:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.161121:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935573.161125:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.161132:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.161215:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:1.0:1784935573.161218:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784935573.161222:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.161238:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17369 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.161283:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44435a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+37:12387:x1871640273185792:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 10199us (10411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935573.161290:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 212 00000100:00100000:2.0:1784935573.168515:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.168613:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273186432 00000100:00100000:1.0:1784935573.168623:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273186432 00000100:00100000:1.0:1784935573.168680:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:1.0:1784935573.168689:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+37:12387:x1871640273186432:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:1.0:1784935573.168901:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+38:12387:x1871640273186432:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 213us (394us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1784935573.168909:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:2.0:1784935573.248020:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.248108:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273186688 00000100:00100000:0.0:1784935573.248118:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273186688 00000100:00100000:0.0:1784935573.248186:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 213 00000100:00100000:0.0:1784935573.248195:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+38:12398:x1871640273186688:12345-192.168.203.28@tcp:101:cat.0 00010000:00010000:0.0:1784935573.248217:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935573.248237:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b17370 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac26 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248305:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17377 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248319:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17377 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248330:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17377 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248343:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1737e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248350:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1737e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248373:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1737e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248480:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b17385 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248489:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b17385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248496:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b17385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935573.248505:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1784935573.248576:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17377 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248584:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17377 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248590:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17377 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248596:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935573.248599:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17377 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248608:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17377 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248618:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:0.0:1784935573.248621:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935573.248636:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17377 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248642:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17377 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248656:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1737e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248661:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1737e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248666:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1737e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248671:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935573.248674:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1737e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248680:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1737e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248688:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d45705a8900) 00010000:00010000:0.0:1784935573.248691:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935573.248693:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1737e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248699:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1737e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248745:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b17370 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac26 expref: 41 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248767:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b17385 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac26 expref: 40 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.248774:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:0.0:1784935573.248776:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935573.248778:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699200, rc 0) 00000100:00100000:0.0:1784935573.248960:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+40:12398:x1871640273186688:12345-192.168.203.28@tcp:101:cat.0 Request processed in 730us (911us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1784935573.248967:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 213 00000100:00100000:2.0:1784935573.257635:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.257702:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273186944 00000100:00100000:1.0:1784935573.257711:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273186944 00000100:00100000:1.0:1784935573.257776:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 54 00000100:00100000:1.0:1784935573.257786:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+40:12398:x1871640273186944:12345-192.168.203.28@tcp:35:cat.0 00000100:00100000:1.0:1784935573.258237:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+41:12398:x1871640273186944:12345-192.168.203.28@tcp:35:cat.0 Request processed in 451us (612us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1784935573.258246:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 54 00000100:00100000:2.0:1784935573.276891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.277074:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273187200 00000100:00100000:1.0:1784935573.277084:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273187200 00000100:00100000:1.0:1784935573.277190:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 214 00000100:00100000:1.0:1784935573.277201:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+41:12399:x1871640273187200:12345-192.168.203.28@tcp:36:rm.0 00010000:00010000:1.0:1784935573.277285:0:7797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1784935573.277316:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021800/0x857e02f4e0b17323 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac11 expref: 41 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.277339:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b17385 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac26 expref: 40 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.277352:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b1735b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac1f expref: 39 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.277364:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17315 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac0a expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.277374:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:1.0:1784935573.277379:0:7797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935573.277398:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17393 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.277411:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17393 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.277421:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17393 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.277433:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.277442:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.277448:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278219:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278230:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278238:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784935573.278482:0:7797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1784935573.278495:0:7797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 392528565966ns, next at 393528562972ns, rc = 0 00010000:00010000:1.0:1784935573.278544:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b173a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278554:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b173a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278563:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b173a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278571:0:7797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b173a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278578:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b173a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278584:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b173a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278617:0:7797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784935573.278641:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278658:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173a1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278666:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.278666:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935573.278676:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b173a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278678:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935573.278686:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.278687:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935573.278693:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b173a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.278698:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173a1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.278703:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b173a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.279112:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:1.0:1784935573.279116:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784935573.279121:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:1.0:1784935573.279122:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173a1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.279131:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784935573.279136:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173a1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.279138:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b173a8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.279159:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9600/0x857e02f4e0b173a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.279177:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17393 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.279183:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935573.279185:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17393 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.279190:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17393 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.279192:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935573.279196:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935573.279198:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935573.279210:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17393 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.279217:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17393 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.279228:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935573.279230:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935573.279233:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17393 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.279239:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b17393 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784935573.279250:0:7797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ffa0b04c reply state 00000000f694ad26 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.279259:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.279265:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44431e0c00) 00010000:00010000:1.0:1784935573.279268:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784935573.279270:0:7797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784935573.279363:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+39:12399:x1871640273187200:12345-192.168.203.28@tcp:36:rm.0 Request processed in 2159us (2480us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1784935573.279371:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 214 00000100:00100000:2.0:1784935573.313806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.313916:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273187456 00000100:00100000:1.0:1784935573.313960:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273187456 00000100:00100000:1.0:1784935573.314026:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 215 00000100:00100000:1.0:1784935573.314035:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+39:12405:x1871640273187456:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935573.314058:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935573.314094:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b173af lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac2d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.314202:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.314217:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.314228:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.314237:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.314244:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.314250:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784935573.314549:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1784935573.314970:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b173c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.314982:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b173c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.314989:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b173c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.315021:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.315040:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173b6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.315046:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.315052:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935573.315057:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.315064:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.315075:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935573.315078:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935573.315082:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.315088:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784935573.315101:0:6525:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa760af5 reply state 00000000abc39fc3 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.315111:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.315116:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44431e0c00) 00010000:00010000:1.0:1784935573.315119:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784935573.315122:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784935573.315148:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b173af lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac2d expref: 42 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.315179:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b173c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac2d expref: 41 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.315187:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d44431e0300) 00010000:00010000:1.0:1784935573.315189:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935573.315191:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9000, rc 0) 00000100:00100000:1.0:1784935573.315262:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+42:12405:x1871640273187456:12345-192.168.203.28@tcp:101:bash.0 Request processed in 1227us (1465us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1784935573.315270:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 215 00000100:00100000:0.0:1784935573.319158:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.319249:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273187584 00000100:00100000:1.0:1784935573.319260:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273187584 00000100:00100000:1.0:1784935573.319324:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 67 00000100:00100000:1.0:1784935573.319334:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273187584:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935573.319352:0:8987:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935573.319373:0:8987:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b173d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac34 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784935573.319397:0:8987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935573.319417:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1784935573.319421:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935573.319430:0:8987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b173d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac34 expref: 8 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.319450:0:8987:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b173d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac34 expref: 8 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.319497:0:8987:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9600, rc 0) 00000100:00100000:1.0:1784935573.319560:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273187584:12345-192.168.203.28@tcp:101:bash.0 Request processed in 227us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935573.319568:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 67 00000100:00080000:2.0:1784935573.320252:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784935573.322658:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935573.322841:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273187712 00000100:00100000:3.0:1784935573.322851:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273187712 00000100:00100000:3.0:1784935573.323013:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 68 00000100:00100000:3.0:1784935573.323025:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+8:12405:x1871640273187712:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:3.0:1784935573.323046:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935573.323066:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac3b expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.323115:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b173d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac34 expref: 9 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.323124:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935573.323128:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935573.323144:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.323189:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b173d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac34 expref: 9 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.323203:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b173d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac34 expref: 9 pid: 8987 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935573.323218:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1871640292108928:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935573.323311:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432d3780 going to sleep for 11 seconds 00000100:00100000:0.0:1784935573.325956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.326040:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273187840 00000100:00100000:1.0:1784935573.326049:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273187840 00010000:00010000:1.0:1784935573.326092:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b173d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac34 expref: 10 pid: 8987 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.326135:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 94 00000100:00100000:1.0:1784935573.326153:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+10:2392:x1871640273187840:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935573.326177:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935573.326198:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b173d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac34 expref: 10 pid: 8987 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.326213:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b173d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac34 expref: 10 pid: 8987 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.326238:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935573.326242:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935573.326251:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.326262:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.326318:0:9527:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.326332:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9527:1871640292109056:192.168.203.28@tcp:105: 00000100:00100000:1.0:1784935573.326410:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf180 going to sleep for 11 seconds 00010000:00010000:3.0:1784935573.326866:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b173d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac34 expref: 10 pid: 8987 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935573.326882:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1871640292108928:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935573.326902:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.326912:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021a00, rc 0) 00000100:00100000:3.0:1784935573.326991:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+9:12405:x1871640273187712:12345-192.168.203.28@tcp:101:bash.0 Request processed in 3968us (4351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935573.326999:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 68 00000100:00100000:1.0:1784935573.329923:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9527:1871640292109056:192.168.203.28@tcp:105: 00010000:00010000:1.0:1784935573.329984:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935573.330038:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2392:x1871640273187840:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 3885us (4116us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935573.330049:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 94 00000100:00100000:0.0:1784935573.332187:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.332266:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273188096 00000100:00100000:1.0:1784935573.332274:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273188096 00000100:00100000:1.0:1784935573.332326:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 55 00000100:00100000:1.0:1784935573.332335:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+42:12405:x1871640273188096:12345-192.168.203.28@tcp:35:bash.0 00000100:00100000:1.0:1784935573.332691:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+43:12405:x1871640273188096:12345-192.168.203.28@tcp:35:bash.0 Request processed in 356us (512us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1784935573.332699:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 55 00000100:00100000:2.0:1784935573.447838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.448069:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273188224 00000100:00100000:0.0:1784935573.448079:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273188224 00000100:00100000:0.0:1784935573.448136:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 216 00000100:00100000:0.0:1784935573.448145:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+43:12421:x1871640273188224:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935573.448179:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935573.448199:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b173e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac42 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.448384:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b173e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.448399:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b173e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.448410:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b173e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935573.448446:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1784935573.448450:0:12375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935573.448465:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b173e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.448486:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b173e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac42 expref: 45 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.448503:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b173e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac42 expref: 44 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.448523:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:0.0:1784935573.448526:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784935573.448528:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698400, rc 0) 00000100:00100000:0.0:1784935573.448699:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+44:12421:x1871640273188224:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 554us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935573.448706:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 216 00000100:00100000:2.0:1784935573.455406:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.455481:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273188480 00000100:00100000:1.0:1784935573.455490:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273188480 00000100:00100000:1.0:1784935573.455581:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 217 00000100:00100000:1.0:1784935573.455592:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+44:12421:x1871640273188480:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:1.0:1784935573.455613:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935573.455630:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b173ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac49 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.455739:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.455752:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.455763:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935573.455772:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1784935573.455859:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8a00/0x857e02f4e0b173ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac49 expref: 47 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.455876:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac49 expref: 46 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.455884:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d44431e0300) 00010000:00010000:1.0:1784935573.455887:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935573.455890:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8800, rc 0) 00000100:00100000:1.0:1784935573.455995:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+46:12421:x1871640273188480:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 404us (596us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1784935573.456002:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 217 00000100:00100000:2.0:1784935573.466984:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935573.467384:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.467565:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273188864 00000100:00100000:0.0:1784935573.467574:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273188864 00000100:00100000:0.0:1784935573.467642:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:0.0:1784935573.467653:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443ded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+46:2391:x1871640273188864:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935573.467670:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935573.467694:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b173f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac49 expref: 46 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.467711:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d44431e0300) 00010000:00010000:0.0:1784935573.467715:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935573.467780:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443ded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+45:2391:x1871640273188864:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 129us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935573.467787:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:3.0:1784935573.468392:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273188736 00000100:00100000:3.0:1784935573.468398:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273188736 00000100:00100000:3.0:1784935573.468517:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 218 00000100:00100000:3.0:1784935573.468525:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+45:12421:x1871640273188736:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935573.468543:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935573.468557:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17403 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac50 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.468641:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1740a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.468654:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1740a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.468663:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1740a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935573.468673:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784935573.468766:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17403 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac50 expref: 48 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.468782:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1740a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac50 expref: 47 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.468791:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d44431e0300) 00010000:00010000:3.0:1784935573.468793:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784935573.468806:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021600, rc 0) 00000100:00100000:3.0:1784935573.468847:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+47:12421:x1871640273188736:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 324us (1873us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1784935573.468853:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 218 00000100:00100000:2.0:1784935573.475672:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.475839:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273188992 00000100:00100000:1.0:1784935573.475849:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273188992 00000100:00100000:1.0:1784935573.476210:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 69 00000100:00100000:1.0:1784935573.476222:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2394:x1871640273188992:12345-192.168.203.28@tcp:1:lfs.0 00010000:00010000:1.0:1784935573.476267:0:8987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.476527:0:8987:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.476535:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935573.478779:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784935573.479052:0:8987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.479113:0:8987:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.479132:0:8987:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 8 pid: 8440 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.479154:0:8987:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8987:1871640292109184:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935573.479340:0:8987:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf780 going to sleep for 11 seconds 00000100:00100000:2.0:1784935573.483516:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935573.484251:0:8444:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273189120 00000100:00100000:3.0:1784935573.484262:0:8444:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273189120 00002000:00100000:3.0:1784935573.484314:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8d4443ded880 x1871640273189120/t0(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:69/0 lens 504/0 e 0 to 0 dl 1784935584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784935573.484325:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443ded880 with x1871640273189120 ext(0->8) 00010000:00010000:3.0:1784935573.484335:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 9 pid: 8440 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.484364:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 9 pid: 8440 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784935573.484372:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4443ded880 00000100:00100000:3.0:1784935573.484404:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 3 00000100:00100000:3.0:1784935573.484413:0:8444:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2391:x1871640273189120:12345-192.168.203.28@tcp:4:lfs.0 00000100:00100000:1.0:1784935573.484534:0:8987:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8987:1871640292109184:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935573.484556:0:8987:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935573.485339:0:8444:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+11:2391:x1871640273189120:12345-192.168.203.28@tcp:4:lfs.0 Request processed in 924us (1829us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1784935573.485348:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 3 00002000:00100000:3.0:1784935573.485357:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8d4443ded880 x1871640273189120/t4294967309(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:69/0 lens 504/448 e 0 to 0 dl 1784935584 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784935573.485365:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443ded880 with x1871640273189120 ext(0->8) 00010000:00010000:3.0:1784935573.485372:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 11 pid: 8440 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.485391:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 11 pid: 8440 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784935573.485398:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d4443ded880 00000100:00100000:2.0:1784935573.487465:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.487558:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273189248 00000100:00100000:0.0:1784935573.487567:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273189248 00010000:00010000:0.0:1784935573.487604:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 11 pid: 8440 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935573.487645:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 95 00000100:00100000:0.0:1784935573.487669:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+11:2391:x1871640273189248:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935573.487685:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784935573.487700:0:6510:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784935573.487703:0:6510:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784935573 00002000:00010000:0.0:1784935573.487706:0:6510:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1784935573 00002000:00010000:0.0:1784935573.487708:0:6510:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1784935573 00002000:00010000:0.0:1784935573.487710:0:6510:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784935573.487717:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 11 pid: 8440 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.487735:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 11 pid: 8440 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.487757:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd615a1f/0x857e02f4e0b173d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac3b expref: 11 pid: 8440 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.487774:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784935573.487779:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784935573.487785:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.487794:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.487816:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935573.487832:0:8987:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.487841:0:8987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.487866:0:8987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.487883:0:8987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.487892:0:8987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935573.487898:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+10:2391:x1871640273189248:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 231us (442us total) trans 0 rc 0/0 00010000:00010000:1.0:1784935573.487900:0:8987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8a00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935573.487904:0:8987:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.487913:0:8987:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935573.487921:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 95 00010000:00010000:1.0:1784935573.487960:0:8987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.487968:0:8987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17418 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.488012:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2394:x1871640273188992:12345-192.168.203.28@tcp:1:lfs.0 Request processed in 11793us (12350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935573.488020:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 69 00000100:00100000:2.0:1784935573.503760:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.509321:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273189504 00000100:00100000:0.0:1784935573.509336:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273189504 00000100:00100000:0.0:1784935573.509453:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 56 00000100:00100000:0.0:1784935573.509464:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a0a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+47:12421:x1871640273189504:12345-192.168.203.28@tcp:35:lfs.0 00000004:00010000:0.0:1784935573.509526:0:6529:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1740a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac50 expref: 47 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784935573.509717:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1784935573.509752:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1784935573.510037:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1784935573.510091:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.510105:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b173c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac2d expref: 51 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.510112:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.510143:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b173c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac2d expref: 51 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.510156:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b173c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac2d expref: 51 pid: 6525 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935573.510181:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d34000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1871640292109312:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935573.510269:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70540 going to sleep for 11 seconds 00000100:00100000:0.0:1784935573.515397:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d34000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1871640292109312:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935573.515423:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935573.516013:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.516146:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273189632 00000100:00100000:0.0:1784935573.516154:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273189632 00010000:00010000:0.0:1784935573.516193:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b173c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac2d expref: 52 pid: 6525 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935573.516232:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 96 00000100:00100000:0.0:1784935573.516241:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443def800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+52:2392:x1871640273189632:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935573.516275:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935573.516284:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b173c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac2d expref: 52 pid: 6525 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.516296:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b173c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac2d expref: 52 pid: 6525 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.516316:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b173c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac2d expref: 52 pid: 6525 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.516330:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d44431e0300) 00010000:00010000:0.0:1784935573.516335:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.516343:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.516351:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.516512:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935573.516562:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443def800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+51:2392:x1871640273189632:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 322us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935573.516574:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 96 00010000:00010000:2.0:1784935573.517315:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.517324:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784935573.517423:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1784935573.517527:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1784935573.517621:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1871640292109440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784935573.517672:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935573.517848:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4543edf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935573.518336:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292109440 00000100:00100000:1.0:1784935573.518343:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292109440 00000100:00100000:1.0:1784935573.518432:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784935573.518445:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6529:x1871640292109440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784935573.518539:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6529:x1871640292109440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 99us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935573.518547:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:2.0:1784935573.518684:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935573.519178:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1871640292109440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1784935573.519299:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1784935573.519349:0:6529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d34000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1871640292109568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784935573.519377:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935573.519397:0:6529:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70000 going to sleep for 11 seconds 00000100:00100000:1.0:1784935573.519420:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292109568 00000100:00100000:1.0:1784935573.519425:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292109568 00000100:00100000:1.0:1784935573.519492:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784935573.519500:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6529:x1871640292109568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784935573.519609:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6529:x1871640292109568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (230us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1784935573.519615:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1784935573.519671:0:6529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d34000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1871640292109568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1784935573.519704:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1784935573.519735:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.519745:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.519752:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.519758:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935573.519763:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.519771:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.519785:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d44431e0300) 00010000:00010000:0.0:1784935573.519797:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784935573.519803:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.519809:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b1741f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784935573.519898:0:6529:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784935573.519977:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1784935573.519988:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392770060071ns, next at 393770057935ns, rc = 0 00000001:00080000:0.0:1784935573.519994:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1784935573.520015:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d44431e0300) 00010000:00010000:0.0:1784935573.520017:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784935573.520023:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021600/0x857e02f4e0b1740a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac50 expref: 55 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935573.520330:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a0a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+54:12421:x1871640273189504:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 10867us (16580us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1784935573.520338:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 56 00000020:00080000:0.0:1784935573.520342:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1784935573.524688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.524909:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273189760 00000100:00100000:0.0:1784935573.524919:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273189760 00000100:00100000:0.0:1784935573.525075:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 219 00000100:00100000:0.0:1784935573.525086:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+54:12421:x1871640273189760:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935573.525109:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935573.525132:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b17426 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac57 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.525196:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b17426 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac57 expref: 55 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.525226:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b17426 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac57 expref: 55 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.525245:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:0.0:1784935573.525249:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784935573.525252:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698a00, rc 0) 00000100:00100000:0.0:1784935573.525301:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+55:12421:x1871640273189760:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 217us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935573.525308:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 219 00000100:00100000:2.0:1784935573.531705:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.532049:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273190016 00000100:00100000:1.0:1784935573.533191:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273190016 00000100:00100000:1.0:1784935573.533262:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 57 00000100:00100000:1.0:1784935573.533272:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+55:12421:x1871640273190016:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:1.0:1784935573.533500:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+56:12421:x1871640273190016:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 228us (1804us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1784935573.533509:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 57 00010000:00010000:3.0:1784935573.613067:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935573.617606:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.617699:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273190144 00000100:00100000:0.0:1784935573.617709:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273190144 00000100:00100000:2.0:1784935573.618960:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 220 00000100:00100000:2.0:1784935573.619041:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+56:12431:x1871640273190144:12345-192.168.203.28@tcp:34:lfs.0 00010000:00010000:2.0:1784935573.619132:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1742d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619465:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1742d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619477:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1742d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619489:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b17434 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619497:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b17434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619503:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b17434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619581:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1743b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619589:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1743b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619596:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1743b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935573.619660:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1743b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619673:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1742d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619680:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1742d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619686:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1742d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619692:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935573.619696:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1742d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619702:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1742d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619712:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:2.0:1784935573.619715:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935573.619720:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1742d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619725:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b1742d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619741:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b17434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619747:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b17434 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619759:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b17434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619764:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935573.619767:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b17434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619774:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b17434 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619784:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44431e0c00) 00010000:00010000:2.0:1784935573.619787:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935573.619790:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b17434 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619796:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200600/0x857e02f4e0b17434 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619805:0:7797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1743b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619811:0:7797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1743b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619816:0:7797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1743b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619834:0:7797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935573.619836:0:7797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1743b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619850:0:7797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1743b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619858:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935573.619861:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935573.619863:0:7797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1743b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.619869:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1743b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935573.620188:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+56:12431:x1871640273190144:12345-192.168.203.28@tcp:34:lfs.0 Request processed in 1214us (2589us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935573.620197:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 220 00000100:00100000:2.0:1784935573.657139:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935573.657405:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273190400 00000100:00100000:3.0:1784935573.657415:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273190400 00000100:00100000:3.0:1784935573.657471:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 221 00000100:00100000:3.0:1784935573.657490:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+56:12434:x1871640273190400:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935573.657511:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935573.657530:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17442 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac5e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.657615:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17449 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.657631:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17449 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.657641:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17449 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.657650:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17450 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.657657:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.657662:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.657779:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17457 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.657788:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.657795:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935573.657804:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784935573.657877:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17449 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.657884:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17449 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658023:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17449 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658029:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935573.658034:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17449 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658041:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17449 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658052:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:3.0:1784935573.658055:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935573.658059:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17449 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658076:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17449 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658091:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658096:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17450 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658101:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658106:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935573.658109:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658115:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17450 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658122:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44431e0c00) 00010000:00010000:3.0:1784935573.658125:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935573.658128:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17450 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658210:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b17450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658247:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020000/0x857e02f4e0b17442 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac5e expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658262:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac5e expref: 58 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935573.658276:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:3.0:1784935573.658279:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784935573.658281:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021000, rc 0) 00000100:00100000:3.0:1784935573.658458:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+58:12434:x1871640273190400:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 967us (1325us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1784935573.658465:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 221 00000100:00100000:3.0:1784935573.662410:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.662561:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273190528 00000100:00100000:1.0:1784935573.662571:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273190528 00000100:00100000:1.0:1784935573.662644:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 222 00000100:00100000:1.0:1784935573.662654:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+58:12434:x1871640273190528:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:1.0:1784935573.662749:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17465 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.662773:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.662788:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.662823:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.662829:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17465 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.662835:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17465 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.662841:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935573.662844:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17465 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.662851:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17465 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.662862:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:1.0:1784935573.662865:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784935573.662869:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17465 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.662875:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17465 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.663345:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+58:12434:x1871640273190528:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 692us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935573.663353:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 222 00000100:00100000:1.0:1784935573.668183:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.668261:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273190784 00000100:00100000:0.0:1784935573.668271:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273190784 00000100:00100000:0.0:1784935573.668332:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 58 00000100:00100000:0.0:1784935573.668341:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+58:12434:x1871640273190784:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:0.0:1784935573.668586:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+59:12434:x1871640273190784:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 245us (422us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1784935573.668593:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 58 00000100:00100000:2.0:1784935573.755144:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.755587:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273191040 00000100:00100000:1.0:1784935573.755601:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273191040 00000100:00100000:1.0:1784935573.755784:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 223 00000100:00100000:1.0:1784935573.755794:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+59:12444:x1871640273191040:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935573.755818:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935573.755822:0:7797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784935573.755847:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b173e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac42 expref: 59 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.755868:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935573.755873:0:7797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935573.755884:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b1746c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac65 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.756054:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.756067:0:7797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17457 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac5e expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.756075:0:7797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.756132:0:7797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac5e expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.756144:0:7797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac5e expref: 59 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.756157:0:7797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7797:1871640292109696:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935573.756269:0:7797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf780 going to sleep for 11 seconds 00000100:00100000:1.0:1784935573.758800:0:7797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7797:1871640292109696:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935573.758830:0:7797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935573.759589:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.760487:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273191168 00000100:00100000:1.0:1784935573.760499:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273191168 00010000:00010000:1.0:1784935573.760544:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac5e expref: 60 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.760641:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 97 00000100:00100000:1.0:1784935573.760651:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+60:2392:x1871640273191168:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935573.760666:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935573.760674:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac5e expref: 60 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.760686:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac5e expref: 60 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.760724:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021000/0x857e02f4e0b17457 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac5e expref: 60 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.760740:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:1.0:1784935573.760745:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.760754:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.760760:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.760793:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935573.760837:0:7797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.760848:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935573.760873:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:1.0:1784935573.760906:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+59:2392:x1871640273191168:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 255us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935573.760948:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 97 00010000:00010000:2.0:1784935573.761016:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b1746c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac65 expref: 60 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.761030:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac65 expref: 59 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.761050:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935573.761053:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784935573.761055:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8200, rc 0) 00000100:00100000:2.0:1784935573.761082:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+59:12444:x1871640273191040:12345-192.168.203.28@tcp:101:bash.0 Request processed in 5290us (5949us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1784935573.761089:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 223 00000100:00100000:3.0:1784935573.769890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.770284:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273191296 00000100:00100000:1.0:1784935573.770294:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273191296 00000100:00100000:1.0:1784935573.770348:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 224 00000100:00100000:1.0:1784935573.770357:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+59:12444:x1871640273191296:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935573.770382:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935573.770401:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17481 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac6c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.770509:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17488 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.770541:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.770552:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.770661:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b17481 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac6c expref: 61 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.770680:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac6c expref: 60 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.770688:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:1.0:1784935573.770691:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784935573.770694:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8e00, rc 0) 00000100:00100000:1.0:1784935573.770756:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+60:12444:x1871640273191296:12345-192.168.203.28@tcp:101:bash.0 Request processed in 400us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935573.770763:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 224 00000100:00100000:3.0:1784935573.773684:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.776836:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273191552 00000100:00100000:0.0:1784935573.776849:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273191552 00000100:00100000:0.0:1784935573.777534:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 225 00000100:00100000:0.0:1784935573.777546:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+60:12444:x1871640273191552:12345-192.168.203.28@tcp:36:bash.0 00010000:00010000:0.0:1784935573.777776:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.777794:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.777818:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784935573.777862:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1784935573.777898:0:6526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a8f7b051 reply state 000000003788133e transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.777912:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.777947:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:0.0:1784935573.777951:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784935573.777955:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784935573.778050:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+63:12444:x1871640273191552:12345-192.168.203.28@tcp:36:bash.0 Request processed in 506us (4374us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1784935573.778058:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 225 00000020:00080000:0.0:1784935573.778062:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784935573.782180:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.782215:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273191680 00000100:00100000:1.0:1784935573.782225:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273191680 00000100:00100000:1.0:1784935573.782294:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 226 00000100:00100000:1.0:1784935573.782305:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+63:12444:x1871640273191680:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:1.0:1784935573.782328:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935573.782347:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b17496 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac73 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.782434:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.782457:0:7797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac65 expref: 64 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.782465:0:7797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.782499:0:7797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac65 expref: 64 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.782513:0:7797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac65 expref: 64 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.782527:0:7797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7797:1871640292109824:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935573.782620:0:7797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf780 going to sleep for 11 seconds 00000100:00100000:3.0:1784935573.785900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.786369:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273191808 00000100:00100000:0.0:1784935573.786378:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273191808 00010000:00010000:0.0:1784935573.786416:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac65 expref: 65 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935573.786504:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 98 00000100:00100000:0.0:1784935573.786515:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+65:2391:x1871640273191808:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935573.786532:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935573.786539:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac65 expref: 65 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.786574:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac65 expref: 65 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.786597:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:0.0:1784935573.786602:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.786613:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.786621:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.786640:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935573.786698:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+65:2391:x1871640273191808:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 184us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935573.786705:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 98 00010000:00010000:1.0:1784935573.787023:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b17473 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac65 expref: 64 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.787044:0:7797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7797:1871640292109824:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935573.787065:0:7797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.787075:0:7797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.787081:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935573.787132:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1784935573.787143:0:7797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935573.787181:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.787209:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b17496 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac73 expref: 64 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.787223:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac73 expref: 63 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.787231:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:1.0:1784935573.787446:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935573.787451:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8400, rc 0) 00000100:00100000:1.0:1784935573.787754:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+63:12444:x1871640273191680:12345-192.168.203.28@tcp:101:bash.0 Request processed in 5449us (5591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935573.787762:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 226 00000100:00100000:2.0:1784935573.792467:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.792612:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273192064 00000100:00100000:0.0:1784935573.792623:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273192064 00000100:00100000:0.0:1784935573.792679:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 59 00000100:00100000:0.0:1784935573.792688:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+63:12444:x1871640273192064:12345-192.168.203.28@tcp:35:bash.0 00000100:00100000:0.0:1784935573.792907:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+64:12444:x1871640273192064:12345-192.168.203.28@tcp:35:bash.0 Request processed in 219us (461us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1784935573.792916:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 59 00000100:00100000:2.0:1784935573.841897:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.842101:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273192192 00000100:00100000:0.0:1784935573.842112:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273192192 00000100:00100000:0.0:1784935573.842236:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 227 00000100:00100000:0.0:1784935573.842261:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+64:12450:x1871640273192192:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935573.842293:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935573.842314:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b174a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac7a expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.842380:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b174ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.842394:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b174ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.842421:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b174ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935573.842468:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1784935573.842473:0:12375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935573.842490:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b174ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.842514:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b174a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac7a expref: 66 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.842534:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b174ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac7a expref: 65 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.842543:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:0.0:1784935573.842546:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784935573.842549:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698c00, rc 0) 00000100:00100000:0.0:1784935573.842625:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12450:x1871640273192192:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 366us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935573.842641:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 227 00000100:00100000:2.0:1784935573.844391:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.844540:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273192320 00000100:00100000:0.0:1784935573.844548:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273192320 00000100:00100000:0.0:1784935573.844678:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 228 00000100:00100000:0.0:1784935573.844688:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12450:x1871640273192320:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935573.844705:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935573.844723:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b174b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac81 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.844781:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b174b9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.844794:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b174b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.844805:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b174b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.844815:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b174c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.844821:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b174c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.844827:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b174c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.844890:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.844915:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.844922:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935573.844991:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784935573.844996:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935573.845012:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845024:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845032:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b174b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845038:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b174b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845046:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b174b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845052:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935573.845056:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b174b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845064:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b174b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845075:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:0.0:1784935573.845078:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935573.845089:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b174b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845096:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b174b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845109:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b174c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845115:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b174c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845122:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b174c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845127:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935573.845130:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b174c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845136:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b174c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845154:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44431e0c00) 00010000:00010000:0.0:1784935573.845156:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935573.845167:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b174c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845174:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698000/0x857e02f4e0b174c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845198:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b174b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac81 expref: 67 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845221:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac81 expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.845229:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:0.0:1784935573.845231:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935573.845234:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540030e00, rc 0) 00000100:00100000:0.0:1784935573.845292:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12450:x1871640273192320:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 606us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935573.845298:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 228 00000100:00100000:3.0:1784935573.848012:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.848103:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273192576 00000100:00100000:1.0:1784935573.848113:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273192576 00000100:00100000:1.0:1784935573.848189:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 229 00000100:00100000:1.0:1784935573.848200:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12450:x1871640273192576:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:1.0:1784935573.848219:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935573.848238:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b174ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac88 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.848339:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.848354:0:7797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac73 expref: 67 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.848380:0:7797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac81 expref: 67 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.848389:0:7797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.848419:0:7797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac81 expref: 67 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.848432:0:7797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac81 expref: 67 pid: 6526 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.848447:0:7797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7797:1871640292109952:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935573.848553:0:7797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac73 expref: 67 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.848562:0:7797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac73 expref: 67 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935573.848571:0:7797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7797:1871640292110080:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935573.848592:0:7797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf780 going to sleep for 11 seconds 00000100:00100000:3.0:1784935573.850412:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.850704:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273192704 00000100:00100000:0.0:1784935573.850713:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273192704 00010000:00010000:0.0:1784935573.850747:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac81 expref: 68 pid: 6526 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935573.850788:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 99 00000100:00100000:0.0:1784935573.850798:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+68:2392:x1871640273192704:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935573.850812:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935573.850819:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac81 expref: 68 pid: 6526 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.851085:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac81 expref: 68 pid: 6526 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.851092:0:7797:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.28@tcp) returned -22 from blocking AST (req@000000000ed81d9e x1871640292109952) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac81 expref: 68 pid: 6526 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.851111:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935573.851112:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b174c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac81 expref: 68 pid: 6526 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.851119:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935573.851142:0:7797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7797:1871640292109952:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935573.851218:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.851226:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935573.851283:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+67:2392:x1871640273192704:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 486us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935573.851290:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 99 00000100:00100000:3.0:1784935573.853022:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935573.853092:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273192832 00000100:00100000:0.0:1784935573.853100:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273192832 00010000:00010000:0.0:1784935573.853139:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac73 expref: 67 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935573.853185:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 100 00000100:00100000:0.0:1784935573.853195:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+67:2392:x1871640273192832:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935573.853208:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935573.853214:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac73 expref: 67 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.853225:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac73 expref: 67 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.853244:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:0.0:1784935573.853248:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.853257:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.853282:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935573.853301:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935573.853352:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+67:2392:x1871640273192832:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 158us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935573.853359:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 100 00010000:00010000:2.0:1784935573.854227:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1749d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac73 expref: 66 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935573.854247:0:7797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7797:1871640292110080:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935573.854268:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935573.854275:0:7797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.854300:0:7797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.854306:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935573.854326:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784935573.854460:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b174ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac88 expref: 67 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.854475:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac88 expref: 66 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.854483:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935573.854486:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784935573.854488:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8200, rc 0) 00000100:00100000:2.0:1784935573.854576:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12450:x1871640273192576:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 6378us (6574us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1784935573.854584:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 229 00000100:00100000:2.0:1784935573.859211:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.859292:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273193088 00000100:00100000:1.0:1784935573.859303:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273193088 00000100:00100000:1.0:1784935573.859367:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:1.0:1784935573.859377:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12450:x1871640273193088:12345-192.168.203.28@tcp:103:lfs.0 00010000:00010000:1.0:1784935573.859419:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935573.859443:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698a00/0x857e02f4e0b17426 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac57 expref: 66 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.859460:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:1.0:1784935573.859465:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935573.859517:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12450:x1871640273193088:12345-192.168.203.28@tcp:103:lfs.0 Request processed in 141us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935573.859524:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:0.0:1784935573.862115:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935573.862211:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273193216 00000100:00100000:1.0:1784935573.862220:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273193216 00000100:00100000:1.0:1784935573.862275:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 230 00000100:00100000:1.0:1784935573.862285:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12450:x1871640273193216:12345-192.168.203.28@tcp:58:lfs.0 00010000:00010000:1.0:1784935573.863300:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.863322:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935573.863334:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784935573.864388:0:12375:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1784935573.864720:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12450:x1871640273193216:12345-192.168.203.28@tcp:58:lfs.0 Request processed in 2431us (2610us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935573.864730:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 230 00000100:00100000:3.0:1784935573.868686:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935573.870404:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273193344 00000100:00100000:2.0:1784935573.870417:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273193344 00000100:00100000:2.0:1784935573.870535:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 231 00000100:00100000:2.0:1784935573.870547:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+65:12450:x1871640273193344:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935573.870578:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935573.870608:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b174ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac8f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.870682:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.870693:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b174ea lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac8f expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.870718:0:6525:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.870732:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b174ea lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac8f expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.870746:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935573.870749:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784935573.870753:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b174ea lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac8f expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935573.870761:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201400, rc 0) 00000100:00100000:2.0:1784935573.870829:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12450:x1871640273193344:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 284us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935573.870836:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 231 00000040:00080000:0.0:1784935574.381144:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935574.381152:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784935574.381192:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1784935574.381203:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784935574.381342:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d36680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292110208:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784935574.381519:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442a70300 going to sleep for 11 seconds 00000100:00100000:1.0:1784935574.386638:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935574.386791:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273193472 00000100:00100000:2.0:1784935574.386800:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273193472 00000100:00100000:2.0:1784935574.386998:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 232 00000100:00100000:2.0:1784935574.387008:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+67:12451:x1871640273193472:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784935574.387039:0:7797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784935574.387179:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+67:12451:x1871640273193472:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 172us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.387187:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 232 00000100:00100000:0.0:1784935574.387252:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d36680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292110208:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1784935574.391106:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935574.391601:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.392135:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273193600 00000100:00100000:1.0:1784935574.392167:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273193600 00000100:00100000:1.0:1784935574.392257:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 233 00000100:00100000:1.0:1784935574.392268:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12451:x1871640273193600:12345-192.168.203.28@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784935574.392342:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b174f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392360:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b174f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392380:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b174f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392438:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b174f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392446:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b174f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392452:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b174f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392476:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b174ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392485:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b174ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392491:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b174ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935574.392538:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1784935574.392542:0:12375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935574.392560:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b174ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392571:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b174f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392578:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b174f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392595:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b174f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392601:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935574.392605:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b174f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392612:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b174f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392623:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:1.0:1784935574.392626:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935574.392630:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b174f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392635:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b174f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392646:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b174f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392652:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b174f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392657:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b174f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392668:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935574.392672:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b174f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392677:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b174f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392865:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8d44431e0800) 00010000:00010000:1.0:1784935574.392868:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935574.392871:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b174f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392878:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b174f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392893:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b174ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392900:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b174ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392905:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b174ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392910:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935574.392912:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b174ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392918:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b174ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392987:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:1.0:1784935574.392990:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935574.392994:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b174ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.392999:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b174ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.393082:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12451:x1871640273193600:12345-192.168.203.28@tcp:34:lhsmtool_posix.0 Request processed in 814us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935574.393090:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 233 00000100:00100000:2.0:1784935574.397540:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.398015:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273193856 00000100:00100000:1.0:1784935574.398026:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273193856 00000100:00100000:1.0:1784935574.398132:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 234 00000100:00100000:1.0:1784935574.398142:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+66:12451:x1871640273193856:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935574.398174:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935574.398194:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17506 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac96 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398288:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1750d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398303:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1750d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398314:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1750d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935574.398323:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784935574.398418:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1750d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398426:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1750d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398433:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1750d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398439:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935574.398442:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1750d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398450:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1750d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398461:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:1.0:1784935574.398465:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784935574.398469:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1750d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398475:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1750d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398514:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17506 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac96 expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398524:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:1.0:1784935574.398526:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784935574.398530:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17506 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac96 expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.398550:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9c00, rc 0) 00000100:00100000:1.0:1784935574.398619:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+67:12451:x1871640273193856:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 478us (1090us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1784935574.398626:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 234 00000100:00100000:0.0:1784935574.401613:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935574.405544:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273193984 00000100:00100000:2.0:1784935574.405691:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273193984 00000100:00100000:2.0:1784935574.405762:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 235 00000100:00100000:2.0:1784935574.405772:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+67:12451:x1871640273193984:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784935574.405810:0:7797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784935574.411082:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+67:12451:x1871640273193984:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 5301us (9467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.411096:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 235 00000100:00100000:3.0:1784935574.414338:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.414464:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273194240 00000100:00100000:1.0:1784935574.414473:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273194240 00000100:00100000:1.0:1784935574.414535:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 236 00000100:00100000:1.0:1784935574.414544:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+67:12451:x1871640273194240:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935574.414811:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935574.414814:0:12375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784935574.414839:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b174ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac7a expref: 67 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.414858:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935574.414863:0:12375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935574.414874:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b1751b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ac9d expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784935574.415459:0:12375:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1784935574.415795:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b17522 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.415809:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b17522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.415817:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b17522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.415884:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b1751b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac9d expref: 69 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.415902:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b17522 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac9d expref: 68 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.415909:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0800) 00010000:00010000:1.0:1784935574.415912:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784935574.415915:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9000, rc 0) 00000100:00100000:0.0:1784935574.416243:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+68:12451:x1871640273194240:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 1697us (1912us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1784935574.416252:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 236 00000100:00100000:0.0:1784935574.423399:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.423479:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273194496 00000100:00100000:1.0:1784935574.423490:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273194496 00000100:00100000:1.0:1784935574.423548:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 237 00000100:00100000:1.0:1784935574.423568:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+68:12451:x1871640273194496:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784935574.423646:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935574.423672:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9000/0x857e02f4e0b17522 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac9d expref: 68 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423688:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0800) 00010000:00010000:1.0:1784935574.423697:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935574.423716:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17530 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423728:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17530 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423737:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17530 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423762:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17537 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8ac67d5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423769:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17537 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ac67d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423775:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17537 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ac67d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423821:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17530 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423828:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17530 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423834:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17530 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423840:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935574.423844:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17530 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423851:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17530 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423858:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:1.0:1784935574.423861:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935574.423864:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17530 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423884:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8000/0x857e02f4e0b17530 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423899:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17537 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ac67d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423904:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17537 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ac67d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423910:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17537 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ac67d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423914:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935574.423917:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17537 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ac67d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.423922:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17537 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8ac67d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.425065:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8ac67d5b (ffff8d44431e0700) 00010000:00010000:1.0:1784935574.425068:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935574.425071:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17537 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8ac67d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.425076:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17537 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8ac67d5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.425177:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+67:12451:x1871640273194496:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 1618us (1784us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784935574.425186:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 237 00000100:00100000:2.0:1784935574.428913:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.429460:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273194624 00000100:00100000:1.0:1784935574.429470:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273194624 00000100:00100000:1.0:1784935574.429564:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 238 00000100:00100000:1.0:1784935574.429588:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+67:12451:x1871640273194624:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935574.429608:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935574.429639:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1753e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aca4 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.429674:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17545 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.429686:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.429698:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.429801:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b1753e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aca4 expref: 69 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.429818:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17545 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aca4 expref: 68 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.429826:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:1.0:1784935574.429829:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784935574.429832:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9200, rc 0) 00000100:00100000:1.0:1784935574.429902:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+68:12451:x1871640273194624:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 316us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935574.429909:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 238 00000100:00100000:3.0:1784935574.433903:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935574.434042:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273194880 00000100:00100000:0.0:1784935574.434061:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273194880 00000100:00100000:0.0:1784935574.434120:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 239 00000100:00100000:0.0:1784935574.434134:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e1eb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+68:12451:x1871640273194880:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784935574.434224:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.434255:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.434268:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784935574.434424:0:12375:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1784935574.434434:0:12375:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393684505770ns, next at 394684503070ns, rc = 0 00000004:00010000:0.0:1784935574.434485:0:12375:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6835375 reply state 0000000098641b9d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.434497:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.434504:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:0.0:1784935574.434507:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784935574.434510:0:12375:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784935574.434605:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e1eb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+70:12451:x1871640273194880:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 476us (711us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1784935574.434612:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 239 00000100:00100000:0.0:1784935574.440970:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.441188:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273195008 00000100:00100000:1.0:1784935574.441198:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273195008 00000100:00100000:1.0:1784935574.441257:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 240 00000100:00100000:1.0:1784935574.441279:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+70:12451:x1871640273195008:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935574.441303:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935574.441322:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17553 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313acab expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.441375:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17553 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acab expref: 71 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.441390:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17553 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acab expref: 71 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.441407:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:1.0:1784935574.441410:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784935574.441413:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9c00, rc 0) 00000100:00100000:1.0:1784935574.441466:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+71:12451:x1871640273195008:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 188us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935574.441472:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 240 00000100:00100000:2.0:1784935574.445269:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784935574.445296:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292110336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935574.445366:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935574.445455:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292110336 00000100:00100000:2.0:1784935574.445463:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292110336 00000100:00100000:2.0:1784935574.445530:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784935574.445539:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292110464:0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.445543:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292110336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784935574.445570:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935574.445584:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935574.445621:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292110336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935574.445623:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292110976:0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.445634:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784935574.445658:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784935574.445661:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784935574.445675:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292110848:0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.445681:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292111488:0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.445714:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935574.445729:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935574.445748:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784935574.445754:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292111360:0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.445772:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292110592:0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.445778:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935574.445809:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935574.445813:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292111872:0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.445834:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292111104:0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.445844:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935574.445865:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935574.445885:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292111616:0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.445906:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935574.445960:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292110464 00000100:00100000:0.0:1784935574.445965:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292110464 00000100:00100000:0.0:1784935574.445994:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1784935574.446001:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292110464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.446024:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784935574.446035:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292110720:0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.446042:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292110464:12345-0@lo:400:kworker.0 Request processed in 38us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935574.446061:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1784935574.446070:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935574.446095:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292111232:0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.446100:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292110976 00000100:00100000:0.0:1784935574.446106:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292110976 00000100:00100000:2.0:1784935574.446123:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935574.446141:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292111744:0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.446144:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292110720 00000100:00100000:0.0:1784935574.446149:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292110720 00000100:00100000:0.0:1784935574.446180:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784935574.446181:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935574.446192:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292110976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.446213:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784935574.446226:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292110720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.446233:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292110976:12345-0@lo:400:kworker.0 Request processed in 43us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935574.446241:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1784935574.446278:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292110464:0@lo:400:kworker.0 00000100:00100000:1.0:1784935574.446349:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292111488 00000100:00100000:1.0:1784935574.446353:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292111488 00000100:00100000:1.0:1784935574.446386:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292111360 00000100:00100000:1.0:1784935574.446389:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292111360 00000100:00100000:1.0:1784935574.446404:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292111872 00000100:00100000:1.0:1784935574.446407:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292111872 00000100:00100000:1.0:1784935574.446419:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1784935574.446425:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292111488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.446469:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292110720:12345-0@lo:400:kworker.0 Request processed in 247us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.446476:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784935574.446500:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784935574.446508:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292111360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.446539:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292111360:12345-0@lo:400:kworker.0 Request processed in 33us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.446546:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784935574.446560:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784935574.446566:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3652:x1871640292111872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.446609:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3652:x1871640292111872:12345-0@lo:400:kworker.0 Request processed in 43us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.446615:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784935574.446652:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292110336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935574.446680:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292110720:0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.446690:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292111360:0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.446698:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292111872:0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.446739:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292110848 00000100:00100000:2.0:1784935574.446743:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292110848 00000100:00100000:2.0:1784935574.446760:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292110592 00000100:00100000:2.0:1784935574.446763:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292110592 00000100:00100000:2.0:1784935574.446773:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292111104 00000100:00100000:2.0:1784935574.446775:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292111104 00000100:00100000:2.0:1784935574.446789:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292111616 00000100:00100000:2.0:1784935574.446792:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292111616 00000100:00100000:2.0:1784935574.446801:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292111232 00000100:00100000:2.0:1784935574.446803:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292111232 00000100:00100000:2.0:1784935574.446813:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292111744 00000100:00100000:2.0:1784935574.446815:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292111744 00000100:00100000:2.0:1784935574.446826:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1784935574.446831:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292110848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.446868:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292110848:12345-0@lo:400:kworker.0 Request processed in 37us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.446889:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1784935574.446901:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1784935574.446907:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292110592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.447061:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292110592:12345-0@lo:400:kworker.0 Request processed in 153us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.447067:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1784935574.447078:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1784935574.447084:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292111104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.447111:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292111104:12345-0@lo:400:kworker.0 Request processed in 28us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.447116:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1784935574.447127:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1784935574.447131:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292111616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.447167:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292111616:12345-0@lo:400:kworker.0 Request processed in 25us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.447172:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1784935574.447182:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1784935574.447188:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292111232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.447215:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292111232:12345-0@lo:400:kworker.0 Request processed in 27us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.447220:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1784935574.447229:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1784935574.447233:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292111744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.447255:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292111744:12345-0@lo:400:kworker.0 Request processed in 22us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.447261:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00080000:2.0:1784935574.447295:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443d37800 x1871640292111232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935574.447320:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292111232:0@lo:400:kworker.0 00010000:00080000:2.0:1784935574.447334:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443d35180 x1871640292111744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935574.447342:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292111744:0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.447352:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292110848:0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.447404:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935574.447413:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292112000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784935574.447448:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935574.447476:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292112000 00000100:00100000:2.0:1784935574.447480:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292112000 00000100:00100000:2.0:1784935574.447504:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784935574.447510:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3650:x1871640292112000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784935574.447524:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935574.447568:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3650:x1871640292112000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.447574:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784935574.447602:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292112000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935574.448023:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292110976:0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.448043:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292110592:0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.448133:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292111104:0@lo:400:kworker.0 00000100:00100000:0.0:1784935574.448143:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292111616:0@lo:400:kworker.0 00000100:00080000:0.0:1784935574.448231:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935574.448237:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784935574.448239:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784935574.450342:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935574.452193:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273195136 00000100:00100000:2.0:1784935574.452208:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273195136 00000100:00100000:2.0:1784935574.452294:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 70 00000100:00100000:2.0:1784935574.452304:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2392:x1871640273195136:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1784935574.452467:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935574.452542:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+10:2392:x1871640273195136:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 Request processed in 238us (2208us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1784935574.452562:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 70 00000100:00100000:2.0:1784935574.453244:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292111488:12345-0@lo:400:kworker.0 Request processed in 6815us (7527us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.453253:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784935574.453350:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292111488:0@lo:400:kworker.0 00000100:00100000:2.0:1784935574.460848:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935574.461348:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273195392 00000100:00100000:0.0:1784935574.461359:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273195392 00000100:00100000:0.0:1784935574.461417:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 60 00000100:00100000:0.0:1784935574.461428:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+71:12451:x1871640273195392:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784935574.461691:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+72:12451:x1871640273195392:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 264us (852us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1784935574.461699:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 60 00000100:00100000:0.0:1784935574.465546:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935574.465805:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273195648 00000100:00100000:2.0:1784935574.465816:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273195648 00000100:00100000:2.0:1784935574.465889:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 241 00000100:00100000:2.0:1784935574.465899:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+72:12451:x1871640273195648:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784935574.466068:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+72:12451:x1871640273195648:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 169us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.466078:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 241 00000100:00100000:2.0:1784935574.471796:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.472339:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273195776 00000100:00100000:1.0:1784935574.472349:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273195776 00000100:00100000:0.0:1784935574.472528:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 242 00000100:00100000:0.0:1784935574.472539:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+72:12451:x1871640273195776:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784935574.472570:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935574.472594:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b1755a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313acb2 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.472676:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b17561 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.472720:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b17561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.472732:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b17561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935574.472789:0:7797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935574.472810:0:7797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b17561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.472835:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b1755a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb2 expref: 74 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.472852:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b17561 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb2 expref: 73 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.472861:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:0.0:1784935574.472864:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784935574.472867:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698c00, rc 0) 00000100:00100000:0.0:1784935574.472983:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+73:12451:x1871640273195776:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 446us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935574.472990:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 242 00000100:00100000:3.0:1784935574.476554:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935574.476655:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273195904 00000100:00100000:2.0:1784935574.476665:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273195904 00000100:00100000:2.0:1784935574.476751:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 71 00000100:00100000:2.0:1784935574.476762:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+10:2392:x1871640273195904:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784935574.476781:0:8987:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935574.476801:0:8987:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17568 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313acb9 expref: -99 pid: 8987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935574.476842:0:8987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63f496, blocks: 0x0 00010000:00010000:2.0:1784935574.476868:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1784935574.476872:0:8987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935574.476881:0:8987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17568 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb9 expref: 11 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.476913:0:8987:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17568 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb9 expref: 11 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.476961:0:8987:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201000, rc 0) 00000100:00100000:2.0:1784935574.477022:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+11:2392:x1871640273195904:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 262us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.477031:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 71 00000100:00100000:1.0:1784935574.481522:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935574.481637:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273196160 00000100:00100000:2.0:1784935574.481646:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273196160 00000100:00100000:2.0:1784935574.481747:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 243 00000100:00100000:2.0:1784935574.481759:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+73:12451:x1871640273196160:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784935574.482395:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+73:12451:x1871640273196160:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 636us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.482404:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 243 00000100:00100000:0.0:1784935574.490798:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935574.490953:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273196288 00000100:00100000:3.0:1784935574.490963:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273196288 00000100:00100000:3.0:1784935574.491020:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 72 00000100:00100000:3.0:1784935574.491030:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+11:12451:x1871640273196288:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784935574.491048:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935574.491064:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313acc0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.491111:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17568 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb9 expref: 12 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.491120:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935574.491124:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935574.491250:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.491288:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17568 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb9 expref: 12 pid: 8987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.491300:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17568 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb9 expref: 12 pid: 8987 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935574.491315:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1871640292112128:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935574.491448:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432d33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935574.498827:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935574.498972:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273196416 00000100:00100000:0.0:1784935574.498982:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273196416 00010000:00010000:0.0:1784935574.499022:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17568 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb9 expref: 13 pid: 8987 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935574.499099:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 101 00000100:00100000:0.0:1784935574.499109:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+13:2391:x1871640273196416:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935574.499124:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935574.499163:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17568 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb9 expref: 13 pid: 8987 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.499177:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17568 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb9 expref: 13 pid: 8987 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.499200:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935574.499205:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935574.499213:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 13 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.499224:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 13 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.499256:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 13 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935574.499268:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6512:1871640292112256:192.168.203.28@tcp:105: 00000100:00100000:0.0:1784935574.499346:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4559917780 going to sleep for 11 seconds 00010000:00010000:3.0:1784935574.500341:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17568 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb9 expref: 13 pid: 8987 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935574.500361:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1871640292112128:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935574.500384:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.500395:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020a00, rc 0) 00000100:00100000:3.0:1784935574.500440:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+12:12451:x1871640273196288:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 9412us (9654us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935574.502590:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 72 00000100:00100000:0.0:1784935574.507611:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6512:1871640292112256:192.168.203.28@tcp:105: 00010000:00010000:0.0:1784935574.507657:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935574.507726:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+11:2391:x1871640273196416:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 8617us (8916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935574.507736:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 101 00000100:00100000:2.0:1784935574.510843:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935574.511002:0:8446:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273196544 00000100:00100000:0.0:1784935574.511012:0:8446:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273196544 00002000:00100000:0.0:1784935574.511071:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8d4443d32300 x1871640273196544/t0(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:70/0 lens 504/0 e 0 to 0 dl 1784935585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784935574.511083:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443d32300 with x1871640273196544 ext(0->12) 00002000:00010000:0.0:1784935574.511089:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443d32300 00000100:00100000:0.0:1784935574.511127:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 6 00000100:00100000:0.0:1784935574.511147:0:8446:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+11:2392:x1871640273196544:12345-192.168.203.28@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784935574.518167:0:8446:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+13:2392:x1871640273196544:12345-192.168.203.28@tcp:4:lhsmtool_posix.0 Request processed in 6999us (7311us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1784935574.518181:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 6 00002000:00100000:0.0:1784935574.518195:0:8446:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8d4443d32300 x1871640273196544/t4294967321(0) o4->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:70/0 lens 504/448 e 0 to 0 dl 1784935585 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784935574.518210:0:8446:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443d32300 with x1871640273196544 ext(0->12) 00002000:00010000:0.0:1784935574.518217:0:8446:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443d32300 00000100:00100000:2.0:1784935574.526170:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.526240:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273196672 00000100:00100000:1.0:1784935574.526250:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273196672 00000100:00100000:1.0:1784935574.526307:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 244 00000100:00100000:1.0:1784935574.526316:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+73:12451:x1871640273196672:12345-192.168.203.28@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784935574.528068:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1784935574.528083:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00010000:00010000:2.0:1784935574.528188:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528200:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528208:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528227:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935574.528232:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528240:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528256:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d44434a7400) 00010000:00010000:2.0:1784935574.528270:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935574.528275:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528282:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699600/0x857e02f4e0b17274 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528312:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528319:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528325:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528330:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935574.528333:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528339:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528357:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d44431e0100) 00010000:00010000:2.0:1784935574.528359:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935574.528362:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528368:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698e00/0x857e02f4e0b1731c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528384:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528391:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528397:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528402:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935574.528405:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528411:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528418:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44431e0c00) 00010000:00010000:2.0:1784935574.528420:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935574.528423:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528428:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b1739a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528451:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528457:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528464:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528470:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935574.528473:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528480:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528488:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44431e0c00) 00010000:00010000:2.0:1784935574.528491:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935574.528494:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528500:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b173bd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528525:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528532:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528539:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528549:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935574.528553:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528560:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528569:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935574.528571:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935574.528575:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528581:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699200/0x857e02f4e0b1748f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528595:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528602:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528609:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528614:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935574.528618:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528624:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528642:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:2.0:1784935574.528645:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784935574.528648:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.528654:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b1754c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784935574.528763:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1784935574.528791:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d4442a70c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1784935574.528796:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d44435c4300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d4442a70540 00000020:00080000:3.0:1784935574.528799:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d44435c4b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d4443e77200 00000004:00080000:3.0:1784935574.528834:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:2.0:1784935574.528987:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292112384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784935574.529048:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1784935574.529142:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1784935574.530746:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292112384 00000100:00100000:2.0:1784935574.530758:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292112384 00000100:00100000:2.0:1784935574.530855:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784935574.530863:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1871640292112384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784935574.530887:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1784935574.530912:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a63f495, atime: 0x6a63f495, ctime: 0x6a63f495, blocks: 0x8 00010000:00010000:2.0:1784935574.530918:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88ba55d/0x857e02f4e0b17576 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.530945:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1784935574.530948:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935574.530954:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e88ba55d/0x857e02f4e0b17576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.530965:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e88ba55d/0x857e02f4e0b17576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.530995:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88ba55d/0x857e02f4e0b17576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.531000:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e88ba55d/0x857e02f4e0b17576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.531012:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784935574.531153:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3650:x1871640292112384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 291us (2105us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784935574.531171:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:0.0:1784935574.531306:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935574.531314:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e88ba55d/0x857e02f4e0b17576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.531322:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201c00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935574.531334:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88ba55d/0x857e02f4e0b17576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.531342:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88ba55d/0x857e02f4e0b17576 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.531358:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e88ba55d/0x857e02f4e0b17576 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.531365:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e88ba55d/0x857e02f4e0b17576 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.531385:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935574.531387:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935574.531389:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784935574.531785:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d4443d32a00/2, rc 0, transno 4294967311 00000100:00100000:2.0:1784935574.531794:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292112384:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784935574.533363:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292112640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784935574.533428:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935574.533521:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935574.533529:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292112512:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784935574.533561:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292112640 00000100:00100000:2.0:1784935574.533568:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292112640 00000100:00100000:1.0:1784935574.533568:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935574.533675:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292112512 00000100:00100000:2.0:1784935574.533680:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292112512 00000100:00100000:2.0:1784935574.533907:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784935574.533954:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784935574.533965:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1871640292112512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784935574.533990:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00000100:00100000:2.0:1784935574.533997:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1871640292112640:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1784935574.534012:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.534032:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070594ba8/0x857e02f4e0b1732a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac18 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.534041:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1784935574.534045:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784935574.534050:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.534076:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070594ba8/0x857e02f4e0b1732a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac18 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935574.534097:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784935574.534100:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1784935574 00010000:00010000:1.0:1784935574.534101:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070594ba8/0x857e02f4e0b1732a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac18 expref: 12 pid: 8440 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935574.534103:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784935574.534105:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1784935574 -> 1784935574 00002000:00010000:2.0:1784935574.534107:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1784935574.534114:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1871640292112768:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935574.534173:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf780 going to sleep for 11 seconds 00000100:00100000:2.0:1784935574.534358:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3652:x1871640292112640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 441us (929us total) trans 4294967322 rc 0/0 00000004:00080000:1.0:1784935574.534372:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d4443d34e00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1784935574.534374:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784935574.534377:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292112640:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1784935574.535979:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d45491539c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1784935574.535986:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d44421eb100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d4549153f00 00000020:00080000:3.0:1784935574.535988:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d44421eb700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d4443e76800 00000020:00080000:3.0:1784935574.536004:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1784935574.536946:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935574.537186:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1871640292112768:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935574.537209:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.537346:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273196800 00000100:00100000:1.0:1784935574.537354:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273196800 00010000:00010000:1.0:1784935574.537397:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070594ba8/0x857e02f4e0b1732a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac18 expref: 13 pid: 8440 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.537438:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 102 00000100:00100000:1.0:1784935574.537447:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+13:2391:x1871640273196800:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935574.537461:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935574.537467:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070594ba8/0x857e02f4e0b1732a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac18 expref: 13 pid: 8440 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.537480:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070594ba8/0x857e02f4e0b1732a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac18 expref: 13 pid: 8440 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.537503:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070594ba8/0x857e02f4e0b1732a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac18 expref: 13 pid: 8440 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.537537:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784935574.537542:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784935574.537547:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.537555:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.537601:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935574.537687:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+12:2391:x1871640273196800:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 239us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935574.537697:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 102 00000020:00080000:1.0:1784935574.537719:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000001:00080000:3.0:1784935574.537723:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1784935574.537732:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:3.0:1784935574.537762:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.537772:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.537793:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784935574.537800:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1784935574.537802:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.537821:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784935574.537891:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+21:12451:x1871640273196672:12345-192.168.203.28@tcp:44:lhsmtool_posix.0 Request processed in 11575us (11740us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935574.537899:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 244 00010000:00010000:2.0:1784935574.538123:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935574.538130:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.538136:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8a00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935574.538139:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.538146:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.538163:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.538171:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd47a62a/0x857e02f4e0b1757d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.538184:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935574.538185:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935574.538186:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935574.538573:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3652:x1871640292112512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4609us (5001us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1784935574.538582:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1784935574.538656:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d4443d30000/2, rc 0, transno 4294967323 00000100:00100000:1.0:1784935574.538663:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292112512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784935574.539507:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935574.539668:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273196928 00000100:00100000:2.0:1784935574.539677:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273196928 00000100:00100000:2.0:1784935574.539759:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 76 00000100:00100000:2.0:1784935574.539769:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+12:2392:x1871640273196928:12345-192.168.203.28@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1784935574.541514:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1784935574.541529:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1784935574.541795:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273196928:12345-192.168.203.28@tcp:16:lhsmtool_posix.0 Request processed in 2022us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.541806:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 76 00000100:00100000:3.0:1784935574.545012:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935574.545051:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273197184 00000100:00100000:2.0:1784935574.545062:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273197184 00000100:00100000:2.0:1784935574.545229:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 245 00000100:00100000:2.0:1784935574.545241:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+21:12451:x1871640273197184:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784935574.545294:0:7797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935574.545321:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b17561 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acb2 expref: 21 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.545341:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:2.0:1784935574.545346:0:7797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935574.545443:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.545455:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.545463:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935574.545564:0:7797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006db48298 reply state 00000000e712bd6d transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.545572:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.545577:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:2.0:1784935574.545590:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784935574.545593:0:7797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784935574.545693:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+22:12451:x1871640273197184:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 454us (690us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1784935574.545700:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 245 00000100:00100000:1.0:1784935574.550289:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935574.550376:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273197312 00000100:00100000:0.0:1784935574.550385:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273197312 00000100:00100000:0.0:1784935574.550444:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 77 00000100:00100000:0.0:1784935574.550464:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273197312:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784935574.550726:0:8987:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1784935574.550730:0:8987:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1784935574 -> 1784935573 00002000:00010000:0.0:1784935574.550733:0:8987:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1784935573 00002000:00010000:0.0:1784935574.550735:0:8987:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1784935574 -> 1784935573 00002000:00010000:0.0:1784935574.550737:0:8987:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1784935574.550796:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273197312:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 Request processed in 343us (517us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1784935574.550804:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 77 00000100:00100000:1.0:1784935574.560187:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935574.560251:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273197568 00000100:00100000:2.0:1784935574.560261:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273197568 00000100:00100000:2.0:1784935574.560319:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 246 00000100:00100000:2.0:1784935574.560329:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+22:12451:x1871640273197568:12345-192.168.203.28@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784935574.560393:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.560410:0:12375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17545 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aca4 expref: 22 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.560419:0:12375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.560454:0:12375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17545 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aca4 expref: 22 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.560466:0:12375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17545 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aca4 expref: 22 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935574.560480:0:12375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d34700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292112896:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935574.560562:0:12375:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549153600 going to sleep for 11 seconds 00000100:00100000:0.0:1784935574.566304:0:12375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d34700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292112896:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935574.566335:0:12375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.567026:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935574.567174:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273197696 00000100:00100000:0.0:1784935574.567182:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273197696 00010000:00010000:0.0:1784935574.567439:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17545 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aca4 expref: 23 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935574.567489:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 103 00000100:00100000:0.0:1784935574.567499:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+23:2391:x1871640273197696:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935574.567512:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935574.567520:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17545 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aca4 expref: 23 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.567532:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17545 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aca4 expref: 23 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.567553:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17545 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313aca4 expref: 23 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.567569:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:0.0:1784935574.567574:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.567583:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.567590:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.568480:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935574.568548:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+22:2391:x1871640273197696:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 1049us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935574.568558:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 103 00010000:00010000:1.0:1784935574.569561:0:12375:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.569575:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.569612:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.569619:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.569626:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.569632:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935574.569636:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.569643:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.569656:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:1.0:1784935574.569659:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784935574.569663:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.569669:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200800/0x857e02f4e0b1758b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.569947:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+21:12451:x1871640273197568:12345-192.168.203.28@tcp:55:lhsmtool_posix.0 Request processed in 9615us (9765us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784935574.569972:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 246 00000100:00100000:1.0:1784935574.573173:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935574.573253:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273197824 00000100:00100000:0.0:1784935574.573263:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273197824 00000100:00100000:0.0:1784935574.573310:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 78 00000100:00100000:0.0:1784935574.573320:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2392:x1871640273197824:12345-192.168.203.28@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784935574.573365:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.573386:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.573395:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935574.573399:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784935574.573402:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.573448:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.573462:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 8 pid: 8440 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935574.573476:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1871640292113024:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935574.573572:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4559917780 going to sleep for 11 seconds 00000100:00100000:2.0:1784935574.575844:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935574.575963:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1871640292113024:192.168.203.28@tcp:104: 00010000:00010000:0.0:1784935574.575987:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.576176:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273197952 00000100:00100000:1.0:1784935574.576184:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273197952 00010000:00010000:1.0:1784935574.576217:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 9 pid: 8440 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.576254:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 104 00000100:00100000:1.0:1784935574.576263:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+9:2391:x1871640273197952:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935574.576277:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935574.576296:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 9 pid: 8440 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.576309:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 9 pid: 8440 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.576330:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d410e67d/0x857e02f4e0b1756f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc0 expref: 9 pid: 8440 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.576344:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784935574.576348:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784935574.576353:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.576362:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.576398:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935574.576465:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2391:x1871640273197952:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 202us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935574.576473:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 104 00010000:00010000:0.0:1784935574.576575:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.576585:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.576605:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.576613:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.576621:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.576629:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698400 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935574.576633:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.576641:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.576666:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.576674:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4844fd7/0x857e02f4e0b17592 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935574.576738:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2392:x1871640273197824:12345-192.168.203.28@tcp:1:lhsmtool_posix.0 Request processed in 3416us (3581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935574.576746:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 78 00000100:00100000:2.0:1784935574.579604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.579697:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273198208 00000100:00100000:1.0:1784935574.579718:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273198208 00000100:00100000:1.0:1784935574.579776:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 247 00000100:00100000:1.0:1784935574.579795:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+21:12451:x1871640273198208:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784935574.579873:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.579890:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17488 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac6c expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.579899:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.579967:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac6c expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.579981:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac6c expref: 21 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.579993:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292113152:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935574.580071:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935574.584203:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292113152:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935574.584246:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935574.595977:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935574.596343:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273198336 00000100:00100000:3.0:1784935574.596353:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273198336 00010000:00010000:3.0:1784935574.596394:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac6c expref: 22 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935574.596425:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 105 00000100:00100000:3.0:1784935574.596434:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+22:2392:x1871640273198336:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935574.596449:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935574.596456:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac6c expref: 22 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.596469:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac6c expref: 22 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.596503:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17488 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac6c expref: 22 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.596518:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:3.0:1784935574.596524:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b174ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac8f expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.596535:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.596541:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.596549:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.596579:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935574.596624:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.596633:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935574.596698:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+21:2392:x1871640273198336:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 265us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935574.596706:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 105 00010000:00010000:1.0:1784935574.596803:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.596815:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17553 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acab expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.596823:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.596849:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17553 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acab expref: 21 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.596861:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17553 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acab expref: 21 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.596875:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292113280:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935574.596947:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935574.599217:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.599272:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292113280:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935574.599298:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935574.599339:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273198464 00000100:00100000:2.0:1784935574.599347:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273198464 00010000:00010000:2.0:1784935574.599381:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17553 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acab expref: 22 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935574.599420:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 106 00000100:00100000:2.0:1784935574.599429:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+22:2391:x1871640273198464:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935574.599442:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935574.599449:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17553 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acab expref: 22 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.599460:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17553 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acab expref: 22 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.599480:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17553 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313acab expref: 22 pid: 6527 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.599494:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:2.0:1784935574.599497:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.599505:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.599512:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.599585:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935574.599650:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+21:2391:x1871640273198464:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 221us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.599658:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 106 00010000:00010000:1.0:1784935574.600988:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.601001:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784935574.601104:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1784935574.601304:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1784935574.601340:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1784935574.601485:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1871640292113408:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784935574.601543:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935574.601776:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf780 going to sleep for 11 seconds 00000100:00100000:0.0:1784935574.601874:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292113408 00000100:00100000:0.0:1784935574.601881:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292113408 00000100:00100000:0.0:1784935574.601998:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784935574.602008:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1871640292113408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784935574.602090:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1871640292113408:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935574.602097:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784935574.602202:0:6527:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1784935574.602208:0:6527:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:1.0:1784935574.602225:0:6527:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d4443d34e00, transno 4294967322 00000004:00080000:1.0:1784935574.602235:0:6527:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d4443d30000, transno 4294967323 00000100:00100000:1.0:1784935574.602243:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1871640292113408:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1784935574.602338:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1784935574.602379:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1871640292113536:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784935574.602407:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935574.602757:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542cbf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935574.602836:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292113536 00000100:00100000:2.0:1784935574.602842:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292113536 00000100:00100000:2.0:1784935574.602870:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784935574.602876:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1871640292113536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784935574.603005:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6527:x1871640292113536:12345-0@lo:1000:mdt00_002.0 Request processed in 128us (596us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1784935574.603012:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784935574.603227:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1871640292113536:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1784935574.603260:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603269:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603293:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603352:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935574.603357:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603367:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603381:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:1.0:1784935574.603385:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784935574.603389:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603396:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175a0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603417:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603424:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603429:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603434:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935574.603437:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603454:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603464:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:1.0:1784935574.603466:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784935574.603473:0:6527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b174ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac8f expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603483:0:6527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b174ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac8f expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603492:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b174ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac8f expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.603518:0:6527:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b174ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac8f expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.603529:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292113664:192.168.203.28@tcp:105: 00000100:00100000:1.0:1784935574.603610:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784935574.606696:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1871640292113664:192.168.203.28@tcp:105: 00010000:00010000:2.0:1784935574.606724:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606735:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8600/0x857e02f4e0b174e3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606778:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b175a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606791:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b175a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606802:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b175a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606812:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b175a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606819:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b175a7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606849:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b175a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606855:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935574.606859:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b175a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606866:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b175a7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606878:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935574.606881:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935574.606884:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b175a7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606890:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201800/0x857e02f4e0b175a7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606902:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606908:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606915:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606920:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935574.606923:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606961:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606970:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935574.606972:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784935574.606975:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.606981:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17599 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935574.607140:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+24:12451:x1871640273198208:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 27355us (27543us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1784935574.607150:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 247 00000020:00080000:2.0:1784935574.607169:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1784935574.607247:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.607342:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273198592 00000100:00100000:1.0:1784935574.607349:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273198592 00000100:00100000:1.0:1784935574.607390:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 61 00000100:00100000:1.0:1784935574.607398:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+24:12450:x1871640273198592:12345-192.168.203.28@tcp:49:lfs.0 00000100:00100000:1.0:1784935574.607484:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+24:12450:x1871640273198592:12345-192.168.203.28@tcp:49:lfs.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935574.607502:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 61 00000040:00080000:0.0:1784935574.608257:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935574.608264:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1784935574.611288:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.611372:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935574.611443:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273198848 00000100:00100000:2.0:1784935574.611453:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273198848 00000100:00100000:2.0:1784935574.611514:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 248 00000100:00100000:2.0:1784935574.611524:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+24:12450:x1871640273198848:12345-192.168.203.28@tcp:58:lfs.0 00000040:00080000:0.0:1784935574.611675:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000100:00100000:3.0:1784935574.611686:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273199104 00000040:00080000:0.0:1784935574.611688:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784935574.611694:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273199104 00000100:00100000:3.0:1784935574.611730:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 62 00000100:00100000:3.0:1784935574.611739:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a09850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+25:12451:x1871640273199104:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1784935574.611905:0:7797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000004:00080000:3.0:1784935574.611982:0:6528:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784935574.612012:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00000100:00100000:2.0:1784935574.612025:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+26:12450:x1871640273198848:12345-192.168.203.28@tcp:58:lfs.0 Request processed in 501us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.612035:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 248 00010000:00010000:3.0:1784935574.612060:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b175ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.612076:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b175ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.612087:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b175ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.612097:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b175ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.612104:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b175ae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.612110:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b175ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935574.612134:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784935574.612191:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a09850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+26:12451:x1871640273199104:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 454us (818us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1784935574.612199:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 62 00000020:00080000:3.0:1784935574.612202:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784935574.612890:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935574.612898:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b175ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.612908:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554020800 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935574.612919:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b175ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.612960:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b175ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.612974:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:2.0:1784935574.612977:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784935574.612981:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b175ae lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.612987:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020800/0x857e02f4e0b175ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.613000:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935574.613002:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935574.613003:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935574.641870:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935574.650533:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935574.650610:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273199232 00000100:00100000:1.0:1784935574.650621:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273199232 00000100:00100000:1.0:1784935574.650680:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 249 00000100:00100000:1.0:1784935574.650809:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+26:12453:x1871640273199232:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:1.0:1784935574.650839:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935574.650859:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313acc7 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.650916:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b175bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.650961:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b175bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.650972:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b175bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.650986:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b175c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.650993:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b175c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.650999:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b175c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.651063:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.651087:0:12375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac88 expref: 27 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.651095:0:12375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.651128:0:12375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac88 expref: 27 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935574.651141:0:12375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac88 expref: 27 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935574.651167:0:12375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292113792:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935574.651341:0:12375:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a540 going to sleep for 11 seconds 00000100:00100000:1.0:1784935574.655026:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935574.655088:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273199488 00000100:00100000:3.0:1784935574.655098:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273199488 00000100:00100000:3.0:1784935574.655182:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 63 00000100:00100000:3.0:1784935574.655192:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+28:6160:x1871640273199488:12345-192.168.203.28@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784935574.655413:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+29:6160:x1871640273199488:12345-192.168.203.28@tcp:35:ldlm_bl.0 Request processed in 222us (395us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1784935574.655421:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 63 00000100:00100000:2.0:1784935574.655492:0:12375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12375:1871640292113792:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935574.655516:0:12375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935574.658051:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935574.658240:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273199616 00000100:00100000:0.0:1784935574.658249:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273199616 00010000:00010000:0.0:1784935574.658348:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac88 expref: 29 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935574.658430:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 107 00000100:00100000:0.0:1784935574.658466:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+29:2392:x1871640273199616:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935574.658480:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935574.658487:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac88 expref: 29 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.658500:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac88 expref: 29 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.658520:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8200/0x857e02f4e0b174d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac88 expref: 29 pid: 7797 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.658534:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:0.0:1784935574.658538:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.658547:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.658554:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935574.658580:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935574.658636:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+28:2392:x1871640273199616:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 185us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935574.658643:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 107 00010000:00010000:2.0:1784935574.658676:0:12375:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658688:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935574.658734:0:12375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784935574.658738:0:12375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935574.658756:0:12375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658781:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658791:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b175bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658798:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b175bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658804:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b175bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658810:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935574.658814:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b175bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658821:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b175bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658899:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:2.0:1784935574.658903:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935574.658907:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b175bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658913:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b175bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658924:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b175c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658976:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b175c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.658989:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b175c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.659000:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935574.659004:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b175c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.659011:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b175c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.659028:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d44431e0e00) 00010000:00010000:2.0:1784935574.659031:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935574.659034:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b175c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.659039:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b175c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.659073:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8800/0x857e02f4e0b175b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc7 expref: 28 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.659086:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc7 expref: 27 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935574.659093:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935574.659095:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935574.659098:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8c00, rc 0) 00000100:00100000:2.0:1784935574.659146:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+27:12453:x1871640273199232:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 8451us (8616us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935574.659182:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 249 00000100:00100000:0.0:1784935574.963510:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292113920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935574.964188:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935574.964252:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784935574.964272:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292114048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935574.964303:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935574.964425:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292113920 00000100:00100000:0.0:1784935574.964433:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292113920 00000100:00100000:0.0:1784935574.964472:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292114048 00000100:00100000:0.0:1784935574.964475:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292114048 00000100:00100000:0.0:1784935574.964489:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784935574.964496:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292113920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784935574.964517:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1784935574.964865:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292113920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 367us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935574.964873:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784935574.964891:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784935574.964898:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292114048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784935574.964910:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1784935574.964955:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292114048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935574.964961:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784935574.965004:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292114048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935574.965018:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292113920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935575.209287:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935575.209326:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935575.209349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935575.209378:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935575.209398:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935575.209416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935575.209435:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935575.209461:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273199872 00000100:00100000:3.0:1784935575.209469:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273199872 00000100:00100000:3.0:1784935575.209514:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273200384 00000100:00100000:3.0:1784935575.209517:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273200384 00000100:00100000:3.0:1784935575.209536:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273200000 00000100:00100000:3.0:1784935575.209538:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273200000 00000100:00100000:3.0:1784935575.209549:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273200512 00000100:00100000:3.0:1784935575.209551:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273200512 00000100:00100000:3.0:1784935575.209566:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 312 00000100:00100000:3.0:1784935575.209575:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+27:2394:x1871640273199872:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935575.209645:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+27:2394:x1871640273199872:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 71us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935575.209653:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 312 00000100:00100000:3.0:1784935575.209669:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 313 00000100:00100000:3.0:1784935575.209675:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273200384:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935575.209700:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273200384:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935575.209706:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 313 00000100:00100000:3.0:1784935575.209718:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 314 00000100:00100000:3.0:1784935575.209775:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273200000:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935575.209811:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273200000:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 87us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935575.209818:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 314 00000100:00100000:3.0:1784935575.209833:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 315 00000100:00100000:3.0:1784935575.209839:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273200512:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935575.209862:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273200512:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935575.209868:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 315 00000100:00100000:3.0:1784935575.209885:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273199744 00000100:00100000:3.0:1784935575.209889:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273199744 00000100:00100000:3.0:1784935575.209911:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 385 00000100:00100000:3.0:1784935575.209917:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273199744:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935575.209965:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273199744:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 48us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935575.209972:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 385 00000100:00100000:3.0:1784935575.210003:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273200128 00000100:00100000:3.0:1784935575.210007:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273200128 00000100:00100000:3.0:1784935575.210029:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273200256 00000100:00100000:3.0:1784935575.210032:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273200256 00000100:00100000:3.0:1784935575.210050:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 121 00000100:00100000:3.0:1784935575.210056:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2394:x1871640273200128:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935575.210079:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2394:x1871640273200128:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 24us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935575.210084:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 121 00000100:00100000:3.0:1784935575.210095:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 122 00000100:00100000:3.0:1784935575.210107:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273200256:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935575.210131:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2394:x1871640273200256:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 25us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935575.210137:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 122 00000100:00080000:0.0:1784935575.210376:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784935575.210381:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935575.210383:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1784935575.273715:0:14762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784935575.273724:0:14762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784935575.273758:0:14762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1784935575.273764:0:14762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784935575.470977:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935575.471001:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292114176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935575.471071:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935575.471563:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292114176 00000100:00100000:3.0:1784935575.471572:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292114176 00000100:00100000:3.0:1784935575.471626:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784935575.471636:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292114176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784935575.471670:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784935575.471731:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292114176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935575.471738:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784935575.471909:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292114176:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1784935575.663442:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935575.663453:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784935575.663483:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784935575.663494:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784935575.663651:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292114304:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784935575.663813:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547eab9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784935575.664363:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935575.674627:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1871640292114304:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784935575.678738:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935575.679454:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273200640 00000100:00100000:2.0:1784935575.679529:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273200640 00000100:00100000:2.0:1784935575.679594:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 250 00000100:00100000:2.0:1784935575.679605:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+27:12465:x1871640273200640:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784935575.679707:0:7797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784935575.679916:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+27:12465:x1871640273200640:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 312us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935575.679924:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 250 00000100:00100000:3.0:1784935575.685143:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935575.685618:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273200896 00000100:00100000:0.0:1784935575.685630:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273200896 00000100:00100000:0.0:1784935575.685719:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 251 00000100:00100000:0.0:1784935575.685729:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+27:12465:x1871640273200896:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784935575.685751:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935575.685770:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b175d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313acce expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935575.685880:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b175d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935575.685894:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b175d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935575.685907:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b175d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935575.685917:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1784935575.686229:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699c00/0x857e02f4e0b175d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acce expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935575.686248:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b175d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acce expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935575.686257:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:0.0:1784935575.686272:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935575.686342:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699000, rc 0) 00000100:00100000:0.0:1784935575.686528:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+29:12465:x1871640273200896:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 800us (1404us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1784935575.686536:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 251 00000100:00100000:3.0:1784935575.692527:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935575.692685:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273201024 00000100:00100000:2.0:1784935575.692696:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273201024 00000100:00100000:2.0:1784935575.692762:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 19 00000100:00100000:2.0:1784935575.692773:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+29:2391:x1871640273201024:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935575.692788:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935575.692878:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699000/0x857e02f4e0b175d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acce expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935575.692901:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935575.692906:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935575.693034:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+28:2391:x1871640273201024:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 263us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935575.693055:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 19 00000100:00100000:3.0:1784935575.696115:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935575.696219:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273201280 00000100:00100000:2.0:1784935575.696228:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273201280 00000100:00100000:2.0:1784935575.696281:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 252 00000100:00100000:2.0:1784935575.696290:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+28:12465:x1871640273201280:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784935575.696378:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b175e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935575.696395:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b175e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935575.696406:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b175e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935575.696564:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b175e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935575.696572:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b175e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935575.696578:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b175e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935575.696584:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935575.696588:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b175e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935575.696595:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b175e6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935575.696607:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935575.696625:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784935575.696631:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b175e6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935575.696637:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200000/0x857e02f4e0b175e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935575.696760:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+29:12465:x1871640273201280:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 471us (655us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1784935575.696768:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 252 00000040:00080000:0.0:1784935575.697074:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784935575.697079:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784935575.697582:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1784935575.697593:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784935575.710870:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935575.710969:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273201536 00000100:00100000:1.0:1784935575.710978:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273201536 00000100:00100000:1.0:1784935575.711036:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 64 00000100:00100000:1.0:1784935575.711045:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+29:12465:x1871640273201536:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784935575.711277:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+30:12465:x1871640273201536:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 231us (413us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1784935575.711284:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 64 00010000:00010000:2.0:1784935576.685169:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784935577.047971:0:14813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784935577.047981:0:14813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784935577.048011:0:14813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1784935577.048018:0:14813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784935577.234070:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935577.234179:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273201792 00000100:00100000:2.0:1784935577.234189:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273201792 00000100:00100000:2.0:1784935577.234284:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 253 00000100:00100000:2.0:1784935577.234294:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+30:12486:x1871640273201792:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935577.234316:0:7797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935577.234335:0:7797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b175ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313acd5 expref: -99 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.234444:0:7797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b175f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.234458:0:7797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b175f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.234470:0:7797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b175f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935577.234480:0:7797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784935577.234575:0:7797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b175ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acd5 expref: 33 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.234612:0:7797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b175f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acd5 expref: 32 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.234621:0:7797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935577.234625:0:7797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784935577.234628:0:7797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201000, rc 0) 00000100:00100000:2.0:1784935577.234692:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+32:12486:x1871640273201792:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 400us (632us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1784935577.234699:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 253 00000100:00080000:0.0:1784935577.235296:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935577.242890:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935577.243014:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273201920 00000100:00100000:2.0:1784935577.243024:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273201920 00000100:00100000:2.0:1784935577.243076:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 254 00000100:00100000:2.0:1784935577.243084:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+32:12486:x1871640273201920:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:2.0:1784935577.243155:0:12375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b17602 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.243171:0:12375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b17602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.243183:0:12375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b17602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.243214:0:12375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b17602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.243221:0:12375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b17602 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.243242:0:12375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b17602 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.243253:0:12375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935577.243257:0:12375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b17602 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.243265:0:12375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b17602 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.243275:0:12375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:2.0:1784935577.243278:0:12375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784935577.243282:0:12375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b17602 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935577.243288:0:12375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201a00/0x857e02f4e0b17602 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935577.243350:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+32:12486:x1871640273201920:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 266us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935577.243356:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 254 00000100:00100000:1.0:1784935577.317512:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935577.317601:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273202048 00000100:00100000:3.0:1784935577.317625:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273202048 00000100:00100000:3.0:1784935577.317695:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 79 00000100:00100000:3.0:1784935577.317706:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2394:x1871640273202048:12345-192.168.203.28@tcp:101:cat.0 00010000:00010000:3.0:1784935577.317722:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935577.317742:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b17609 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313acdc expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784935577.317767:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a63f495, atime: 0x6a63f495, ctime: 0x6a63f495, blocks: 0x8 00010000:00010000:3.0:1784935577.317785:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1784935577.317790:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935577.317799:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b17609 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acdc expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935577.317818:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b17609 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acdc expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935577.317831:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021200, rc 0) 00000100:00100000:3.0:1784935577.317900:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2394:x1871640273202048:12345-192.168.203.28@tcp:101:cat.0 Request processed in 197us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935577.317907:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 79 00000100:00080000:1.0:1784935577.318665:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935577.331347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935577.331523:0:8444:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273202176 00000100:00100000:2.0:1784935577.331533:0:8444:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273202176 00002000:00100000:2.0:1784935577.331575:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8d4443cd7800 x1871640273202176/t0(0) o3->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:73/0 lens 488/0 e 0 to 0 dl 1784935588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784935577.331587:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443cd7800 with x1871640273202176 ext(0->4095) 00002000:00010000:2.0:1784935577.331593:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443cd7800 00000100:00100000:2.0:1784935577.331623:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:2.0:1784935577.331631:0:8444:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2393:x1871640273202176:12345-192.168.203.28@tcp:3:cat.0 00000100:00100000:2.0:1784935577.331784:0:8444:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2393:x1871640273202176:12345-192.168.203.28@tcp:3:cat.0 Request processed in 153us (446us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784935577.331791:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 7 00002000:00100000:2.0:1784935577.331798:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8d4443cd7800 x1871640273202176/t0(0) o3->380c344d-145d-4a03-bcd4-797f2a6954a7@192.168.203.28@tcp:73/0 lens 488/4536 e 0 to 0 dl 1784935588 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784935577.331806:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d4443cd7800 with x1871640273202176 ext(0->4095) 00002000:00010000:2.0:1784935577.331809:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d4443cd7800 00010000:00010000:2.0:1784935577.713774:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935578.031331:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784935578.031356:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292114432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784935578.031421:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935578.031483:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292114432 00000100:00100000:0.0:1784935578.031491:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292114432 00000100:00100000:0.0:1784935578.031537:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784935578.031546:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292114432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935578.031578:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1784935578.031624:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292114432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935578.031631:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784935578.031676:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292114432:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784935578.735229:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935579.565181:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784935579.565206:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292114560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935579.565276:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935579.565356:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292114560 00000100:00100000:3.0:1784935579.565364:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292114560 00000100:00100000:3.0:1784935579.565421:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784935579.565440:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292114560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784935579.565470:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784935579.565516:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292114560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935579.565523:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1784935579.565542:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935579.565578:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292114560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935579.568296:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292114688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935579.568368:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935579.568811:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292114688 00000100:00100000:3.0:1784935579.568821:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292114688 00000100:00100000:3.0:1784935579.568897:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784935579.568909:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292114688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935579.568912:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292114944:0@lo:400:kworker.0 00000100:00100000:1.0:1784935579.568970:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935579.568995:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292115456:0@lo:400:kworker.0 00000100:00100000:1.0:1784935579.569015:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935579.569034:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292115968:0@lo:400:kworker.0 00002000:00000024:3.0:1784935579.569045:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935579.569057:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935579.569082:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784935579.569099:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292114816:0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.569108:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292114688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935579.569140:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935579.569162:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292115328:0@lo:400:kworker.0 00000100:00100000:1.0:1784935579.569184:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935579.569202:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292115840:0@lo:400:kworker.0 00000100:00100000:1.0:1784935579.569223:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935579.569247:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292115072:0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.569260:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784935579.569280:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784935579.569290:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784935579.569301:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292115584:0@lo:400:kworker.0 00000100:00100000:1.0:1784935579.569325:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935579.569345:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292114944 00000100:00100000:1.0:1784935579.569346:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292116096:0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.569352:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292114944 00000100:00100000:1.0:1784935579.569373:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935579.569590:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292115840 00000100:00100000:0.0:1784935579.569595:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292115840 00000100:00100000:0.0:1784935579.569631:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784935579.569639:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640292115840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935579.569680:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640292115840:12345-0@lo:400:kworker.0 Request processed in 42us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935579.569695:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784935579.569717:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292115328 00000100:00100000:0.0:1784935579.569721:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292115328 00000100:00100000:0.0:1784935579.569746:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292115072 00000100:00100000:0.0:1784935579.569749:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292115072 00000100:00100000:0.0:1784935579.569767:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1784935579.569774:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292115328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935579.569821:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292115328:12345-0@lo:400:kworker.0 Request processed in 48us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935579.569827:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1784935579.569844:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784935579.569851:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292115072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935579.569887:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292115072:12345-0@lo:400:kworker.0 Request processed in 36us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935579.569893:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784935579.569911:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292114816 00000100:00100000:0.0:1784935579.569915:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292114816 00000100:00100000:0.0:1784935579.569972:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1784935579.569980:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292114816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935579.570009:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3652:x1871640292114816:12345-0@lo:400:kworker.0 Request processed in 32us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935579.570015:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1784935579.570390:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292115072:0@lo:400:kworker.0 00000100:00100000:1.0:1784935579.570405:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784935579.570413:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292115200:0@lo:400:kworker.0 00000100:00100000:1.0:1784935579.570441:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935579.573076:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292115456 00000100:00100000:3.0:1784935579.573379:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292115456 00000100:00100000:3.0:1784935579.573438:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292115968 00000100:00100000:3.0:1784935579.573442:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292115968 00000100:00100000:3.0:1784935579.573465:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292115584 00000100:00100000:3.0:1784935579.573467:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292115584 00000100:00100000:3.0:1784935579.573479:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292116096 00000100:00100000:3.0:1784935579.573482:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292116096 00000100:00100000:3.0:1784935579.573500:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1784935579.573509:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292114944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.573613:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292114944:12345-0@lo:400:kworker.0 Request processed in 105us (4642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935579.573620:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1784935579.573638:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1784935579.573645:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292115456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.573673:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292115456:12345-0@lo:400:kworker.0 Request processed in 30us (4657us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935579.573679:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1784935579.573689:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1784935579.573693:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292115968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.574906:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292115968:12345-0@lo:400:kworker.0 Request processed in 22us (4660us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935579.574919:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1784935579.575086:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1784935579.575107:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292115584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.575438:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292115584:12345-0@lo:400:kworker.0 Request processed in 337us (6111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935579.575444:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1784935579.575460:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1784935579.575467:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292116096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.575497:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292116096:12345-0@lo:400:kworker.0 Request processed in 31us (6125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935579.575503:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00080000:3.0:1784935579.575603:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784935579.575609:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784935579.575623:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935579.575683:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1784935579.575689:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1784935579.575712:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d4443d9b800, transno 4294967308 00000004:00080000:3.0:1784935579.576073:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1784935579.576107:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d4443d32a00, transno 4294967311 00000100:00100000:3.0:1784935579.576582:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292114688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935579.578863:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292114816:0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.578883:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292115328:0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.578906:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292115840:0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.578919:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292114944:0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.578945:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292115456:0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.578958:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292115968:0@lo:400:kworker.0 00000100:00100000:2.0:1784935579.581556:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292115200 00000100:00100000:2.0:1784935579.581570:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292115200 00000100:00100000:2.0:1784935579.581655:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1784935579.581667:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292115200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935579.582009:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292115712:0@lo:400:kworker.0 00000100:00100000:2.0:1784935579.587120:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292115200:12345-0@lo:400:kworker.0 Request processed in 5446us (16668us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935579.587146:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1784935579.589572:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784935579.589636:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443664380 x1871640292115584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935579.589653:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292115584:0@lo:400:kworker.0 00010000:00080000:1.0:1784935579.589669:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443666680 x1871640292116096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935579.589679:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292116096:0@lo:400:kworker.0 00000100:00100000:1.0:1784935579.589776:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292115200:0@lo:400:kworker.0 00000100:00100000:3.0:1784935579.590833:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292115712 00000100:00100000:3.0:1784935579.590845:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292115712 00000100:00100000:3.0:1784935579.591068:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784935579.591079:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292115712:12345-0@lo:400:kworker.0 00000001:00080000:0.0:1784935579.591098:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1784935579.591139:0:6504:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d455199fcc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1784935579.591143:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d44437b2f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d455199f600 00000020:00080000:0.0:1784935579.591147:0:6504:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d44437b2000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d444364dc00 00000020:00080000:0.0:1784935579.591169:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:3.0:1784935579.592249:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292115712:12345-0@lo:400:kworker.0 Request processed in 1167us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935579.592262:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784935579.592332:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292115712:0@lo:400:kworker.0 00000100:00080000:1.0:1784935579.592434:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784935579.592458:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935579.592471:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935579.592479:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935579.592485:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935579.592491:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935579.592499:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935579.592517:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d44431e0b00) 00010000:00010000:1.0:1784935579.592520:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935579.592539:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935579.592546:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200e00/0x857e02f4e0b17584 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7797 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784935579.592582:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1784935579.592654:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1784935579.757239:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935580.079634:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292116224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935580.079705:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935580.079783:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292116224 00000100:00100000:0.0:1784935580.079790:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292116224 00000100:00100000:0.0:1784935580.079831:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784935580.079839:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1871640292116224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784935580.079871:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784935580.079915:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1871640292116224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935580.079922:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784935580.079987:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292116224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935580.080428:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935580.080440:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292116352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935580.080473:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935580.080507:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292116352 00000100:00100000:1.0:1784935580.080512:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292116352 00000100:00100000:1.0:1784935580.080535:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784935580.080542:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292116352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784935580.080555:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1784935580.080585:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292116352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935580.080591:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784935580.080619:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292116352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935580.337249:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935580.337301:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935580.337395:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273202432 00000100:00100000:2.0:1784935580.337404:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273202432 00000100:00100000:2.0:1784935580.337480:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 322 00000100:00100000:2.0:1784935580.337490:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+18:2394:x1871640273202432:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935580.337559:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+18:2394:x1871640273202432:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 71us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935580.337567:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 322 00000100:00080000:3.0:1784935580.337636:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935580.337779:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273202304 00000100:00100000:1.0:1784935580.337784:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273202304 00000100:00100000:1.0:1784935580.337815:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 387 00000100:00100000:1.0:1784935580.337822:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273202304:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935580.337857:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2394:x1871640273202304:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 35us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935580.337863:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 387 00000100:00100000:3.0:1784935580.339648:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935580.339701:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935580.339730:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935580.339751:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935580.339773:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935580.339797:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273202944 00000100:00100000:3.0:1784935580.339804:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273202944 00000100:00100000:2.0:1784935580.339826:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273202560 00000100:00100000:2.0:1784935580.339838:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273202560 00000100:00100000:3.0:1784935580.339858:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273203072 00000100:00100000:3.0:1784935580.339863:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273203072 00000100:00100000:2.0:1784935580.339883:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 323 00000100:00100000:3.0:1784935580.339892:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 324 00000100:00100000:2.0:1784935580.339897:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273202944:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935580.339906:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273202560:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935580.339986:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273202560:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 82us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935580.339995:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 324 00000100:00100000:1.0:1784935580.340012:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273202688 00000100:00100000:3.0:1784935580.340016:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 325 00000100:00100000:1.0:1784935580.340022:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273202688 00000100:00100000:3.0:1784935580.340026:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273203072:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935580.340066:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273202816 00000100:00100000:1.0:1784935580.340070:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273202816 00000100:00100000:1.0:1784935580.340100:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 125 00000100:00100000:1.0:1784935580.340108:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2393:x1871640273202688:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935580.342218:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273202944:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 2316us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935580.342232:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 323 00000100:00100000:2.0:1784935580.342316:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 126 00000100:00100000:2.0:1784935580.342327:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273202816:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935580.342374:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2393:x1871640273202816:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 51us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935580.342380:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 126 00000100:00080000:2.0:1784935580.342397:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784935580.342401:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784935580.342404:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784935580.342407:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935580.345704:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:2393:x1871640273203072:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 5668us (5919us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935580.345718:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 325 00000100:00100000:0.0:1784935580.355342:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:380c344d-145d-4a03-bcd4-797f2a6954a7+8:2393:x1871640273202688:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 15225us (15692us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935580.355359:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 125 00000100:00100000:0.0:1784935580.589511:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292116480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935580.589583:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935580.589661:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292116480 00000100:00100000:0.0:1784935580.589668:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292116480 00000100:00100000:0.0:1784935580.589713:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1784935580.589721:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292116480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935580.589757:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935580.589803:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292116480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935580.589821:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1784935580.589870:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292116480:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1784935580.593599:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1784935580.593611:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000040:00080000:0.0:1784935580.653745:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784935580.781211:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784935580.845334:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784935580.845344:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784935580.845363:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784935580.845816:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784935581.806504:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935582.078297:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935582.082686:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273203200 00000100:00100000:0.0:1784935582.082701:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273203200 00000100:00100000:0.0:1784935582.083011:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 255 00000100:00100000:0.0:1784935582.083024:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+18:12131:x1871640273203200:12345-192.168.203.28@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1784935582.083165:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+18:12131:x1871640273203200:12345-192.168.203.28@tcp:60:lhsmtool_posix.0 Request processed in 145us (5418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935582.083172:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 255 00000100:00080000:2.0:1784935582.083558:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784935582.086642:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935582.087254:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273203328 00000100:00100000:2.0:1784935582.087264:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273203328 00000100:00080000:3.0:1784935582.087323:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784935582.087493:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 256 00000100:00100000:2.0:1784935582.087506:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:12131:x1871640273203328:12345-192.168.203.28@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784935582.087608:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:12131:x1871640273203328:12345-192.168.203.28@tcp:60:lhsmtool_posix.0 Request processed in 105us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935582.087615:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 256 00000100:00100000:3.0:1784935582.089168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935582.089262:0:6528:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273203584 00000100:00100000:1.0:1784935582.089270:0:6528:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273203584 00000100:00100000:1.0:1784935582.089322:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 65 00000100:00100000:1.0:1784935582.089331:0:6528:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+18:12131:x1871640273203584:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784935582.089844:0:6528:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+19:12131:x1871640273203584:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 222us (390us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1784935582.089855:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 65 00000100:00100000:3.0:1784935582.378843:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935582.378966:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273203712 00000100:00100000:0.0:1784935582.378976:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273203712 00000100:00100000:0.0:1784935582.379052:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 257 00000100:00100000:0.0:1784935582.379061:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+5:12943:x1871640273203712:12345-192.168.203.28@tcp:101:lsof.0 00010000:00010000:0.0:1784935582.379088:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935582.379122:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b17610 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ace3 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935582.379181:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17617 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935582.379193:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935582.379203:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935582.379273:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784935582.379277:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935582.379299:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935582.379321:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698c00/0x857e02f4e0b17610 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ace3 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935582.379339:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17617 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ace3 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935582.379348:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d44429bbe00) 00010000:00010000:0.0:1784935582.379351:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784935582.379354:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698400, rc 0) 00000100:00100000:0.0:1784935582.379421:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+6:12943:x1871640273203712:12345-192.168.203.28@tcp:101:lsof.0 Request processed in 360us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935582.379428:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 257 00000100:00080000:3.0:1784935582.379806:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784935582.830532:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935583.149459:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292116608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935583.149533:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935583.149671:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292116608 00000100:00100000:3.0:1784935583.149678:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292116608 00000100:00100000:3.0:1784935583.149740:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784935583.149749:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292116608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784935583.149781:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1784935583.149837:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292116608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935583.149845:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1784935583.150025:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292116608:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784935583.853150:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935584.685126:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292116736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935584.685200:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935584.685281:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292116736 00000100:00100000:0.0:1784935584.685288:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292116736 00000100:00100000:0.0:1784935584.685346:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784935584.685357:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292116736:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784935584.685381:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1784935584.685390:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935584.685450:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292116736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935584.685473:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784935584.685760:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292116864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784935584.685798:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935584.685822:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292117376:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.685848:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935584.685869:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292117888:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.685890:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935584.685904:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292118400:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.685950:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935584.685972:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784935584.685978:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292116992:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686004:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935584.686029:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292117504:0@lo:400:kworker.0 00000100:00100000:3.0:1784935584.686044:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292116992 00000100:00100000:3.0:1784935584.686050:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292116992 00000100:00100000:2.0:1784935584.686070:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935584.686084:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1784935584.686100:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292118016:0@lo:400:kworker.0 00000100:00100000:3.0:1784935584.686105:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292116992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686131:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935584.686158:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292116992:12345-0@lo:400:kworker.0 Request processed in 67us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935584.686166:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1784935584.686174:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292116992:0@lo:400:kworker.0 00000100:00100000:3.0:1784935584.686202:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292117248:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686209:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292117888 00000100:00100000:2.0:1784935584.686214:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292117888 00000100:00100000:3.0:1784935584.686231:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935584.686255:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292117760:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686255:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292118400 00000100:00100000:2.0:1784935584.686260:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292118400 00000100:00100000:3.0:1784935584.686281:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935584.686295:0:8441:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292118016 00000100:00100000:3.0:1784935584.686302:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292118272:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686309:0:8441:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292118016 00000100:00100000:3.0:1784935584.686330:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935584.686338:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1784935584.686348:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292117888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935584.686364:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292116736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935584.686382:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784935584.686388:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292117120:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686398:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292117888:12345-0@lo:400:kworker.0 Request processed in 51us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935584.686407:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784935584.686418:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935584.686425:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784935584.686435:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292118400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935584.686441:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292117632:0@lo:400:kworker.0 00000100:00100000:3.0:1784935584.686482:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935584.686489:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292118400:12345-0@lo:400:kworker.0 Request processed in 55us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935584.686497:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784935584.686506:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292118144:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686512:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784935584.686524:0:8441:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292118016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935584.686532:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935584.686558:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292117504 00000100:00100000:3.0:1784935584.686562:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292117504 00000100:00100000:2.0:1784935584.686566:0:8441:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292118016:12345-0@lo:400:kworker.0 Request processed in 44us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935584.686575:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784935584.686580:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292116864 00000100:00100000:1.0:1784935584.686585:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292116864 00000100:00100000:3.0:1784935584.686590:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292117248 00000100:00100000:3.0:1784935584.686593:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292117248 00000100:00100000:3.0:1784935584.686606:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00080000:2.0:1784935584.686610:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935584.686614:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292117504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935584.686614:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1784935584.686616:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935584.686622:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d5e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292116864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935584.686634:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784935584.686635:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292117376 00000100:00100000:2.0:1784935584.686640:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292117376 00000100:00100000:3.0:1784935584.686651:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292117504:12345-0@lo:400:kworker.0 Request processed in 38us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935584.686659:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1784935584.686667:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d5e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292116864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935584.686669:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292117760 00000100:00100000:2.0:1784935584.686673:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292117760 00000100:00100000:3.0:1784935584.686674:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784935584.686677:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784935584.686683:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292117248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686706:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292118272 00000100:00100000:2.0:1784935584.686711:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292118272 00000100:00100000:3.0:1784935584.686719:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292117248:12345-0@lo:400:kworker.0 Request processed in 36us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935584.686725:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1784935584.686735:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292117120 00000100:00100000:2.0:1784935584.686739:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292117120 00000100:00100000:3.0:1784935584.686752:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292117248:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686760:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292117632 00000100:00100000:2.0:1784935584.686764:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292117632 00000100:00100000:3.0:1784935584.686786:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292118144 00000100:00100000:2.0:1784935584.686791:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1784935584.686792:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292118144 00000100:00100000:2.0:1784935584.686810:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292117376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686843:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292117376:12345-0@lo:400:kworker.0 Request processed in 38us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935584.686850:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784935584.686861:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784935584.686867:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292117760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686901:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292117760:12345-0@lo:400:kworker.0 Request processed in 34us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935584.686907:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784935584.686918:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784935584.686923:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292118272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.686971:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292118272:12345-0@lo:400:kworker.0 Request processed in 48us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935584.686977:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784935584.686988:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1784935584.686993:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292117120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.687019:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292117120:12345-0@lo:400:kworker.0 Request processed in 26us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935584.687024:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1784935584.687034:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1784935584.687039:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292117632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.687062:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292117632:12345-0@lo:400:kworker.0 Request processed in 23us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935584.687066:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:2.0:1784935584.687080:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784935584.687099:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784935584.687135:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292117504:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.687146:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1784935584.687151:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1784935584.687168:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292118016:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.687182:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292116864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784935584.687191:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292117376:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.687200:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292117888:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.687208:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292118400:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.687256:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292117120:0@lo:400:kworker.0 00000100:00100000:2.0:1784935584.687267:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292117632:0@lo:400:kworker.0 00010000:00080000:2.0:1784935584.687278:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443d34000 x1871640292117760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935584.687287:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292117760:0@lo:400:kworker.0 00010000:00080000:2.0:1784935584.687298:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443d31c00 x1871640292118272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935584.687305:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292118272:0@lo:400:kworker.0 00000100:00100000:3.0:1784935584.692021:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1784935584.692037:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292118144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935584.692161:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1871640292118144:12345-0@lo:400:kworker.0 Request processed in 128us (5628us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935584.692168:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1784935584.692345:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1871640292118144:0@lo:400:kworker.0 00010000:00010000:2.0:1784935584.878784:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935585.197258:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292118528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935585.197323:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935585.197436:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292118528 00000100:00100000:0.0:1784935585.197443:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292118528 00000100:00100000:0.0:1784935585.197489:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784935585.197497:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292118528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784935585.197522:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784935585.197570:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292118528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935585.197577:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784935585.197700:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292118528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935585.200113:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292118656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935585.200178:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935585.200291:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292118656 00000100:00100000:0.0:1784935585.200298:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292118656 00000100:00100000:0.0:1784935585.200351:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784935585.200361:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292118656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784935585.200381:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784935585.200442:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292118656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935585.200448:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784935585.200531:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292118656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935585.454575:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935585.454644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935585.454675:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935585.454708:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935585.454725:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935585.454742:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935585.454776:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935585.454822:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273203968 00000100:00100000:2.0:1784935585.454835:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273203840 00000100:00100000:1.0:1784935585.454839:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273203968 00000100:00100000:2.0:1784935585.454842:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273203840 00000100:00100000:2.0:1784935585.454895:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 389 00000100:00100000:1.0:1784935585.454898:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273204480 00000100:00100000:1.0:1784935585.454904:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273204480 00000100:00100000:2.0:1784935585.454910:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2391:x1871640273203840:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935585.454923:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273204096 00000100:00100000:3.0:1784935585.455024:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273204608 00000100:00100000:3.0:1784935585.455029:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273204608 00000100:00100000:1.0:1784935585.455048:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273204096 00000100:00100000:3.0:1784935585.455056:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 332 00000100:00100000:3.0:1784935585.455079:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+19:2391:x1871640273203968:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935585.455082:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 333 00000100:00100000:1.0:1784935585.455104:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+6:2391:x1871640273204480:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935585.455188:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 334 00000100:00100000:0.0:1784935585.455198:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273204608:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935585.455315:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2391:x1871640273203840:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 409us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935585.455322:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 389 00000100:00100000:2.0:1784935585.455356:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273204224 00000100:00100000:2.0:1784935585.455360:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273204224 00000100:00100000:2.0:1784935585.455383:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273204352 00000100:00100000:2.0:1784935585.455385:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273204352 00000100:00100000:2.0:1784935585.455410:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 130 00000100:00100000:2.0:1784935585.455416:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45743c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273204224:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935585.455444:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45743c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2391:x1871640273204224:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 28us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935585.455450:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 130 00000100:00100000:2.0:1784935585.455863:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 131 00000100:00100000:2.0:1784935585.455871:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273204352:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935585.455898:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273204352:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 28us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935585.455904:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 131 00000100:00080000:2.0:1784935585.455959:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784935585.455964:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784935585.455966:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784935585.455968:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935585.456053:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+6:2391:x1871640273204480:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 949us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935585.456061:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 333 00000100:00100000:1.0:1784935585.456080:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 335 00000100:00100000:1.0:1784935585.456104:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273204096:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935585.456143:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2391:x1871640273204096:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 42us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935585.456151:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 335 00000100:00100000:0.0:1784935585.456400:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2391:x1871640273204608:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 1202us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935585.456408:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 334 00000100:00100000:3.0:1784935585.456883:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+19:2391:x1871640273203968:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 1816us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935585.456891:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 332 00000100:00100000:2.0:1784935585.713565:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935585.713591:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292118784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935585.713664:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935585.713857:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292118784 00000100:00100000:2.0:1784935585.713865:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292118784 00000100:00100000:0.0:1784935585.715383:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1784935585.715396:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292118784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935585.715820:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784935585.716041:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292118784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 646us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935585.716049:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784935585.716164:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292118784:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1784935585.738104:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1784935585.738117:0:6504:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1784935585.738181:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1784935585.738192:0:6557:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1784935585.901171:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784935586.359334:0:15012:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:26:25 (1784935585) 00010000:00010000:2.0:1784935586.926910:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935587.953211:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935588.269411:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935588.269435:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292118912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935588.269507:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935588.269762:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292118912 00000100:00100000:0.0:1784935588.269770:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292118912 00000100:00100000:0.0:1784935588.269822:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784935588.269832:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d455e146c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292118912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935588.269866:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1784935588.269924:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d455e146c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292118912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935588.269964:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1784935588.270207:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292118912:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784935588.973131:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935589.805354:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784935589.805378:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292119040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935589.805461:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935589.805684:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292119040 00000100:00100000:1.0:1784935589.805693:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292119040 00000100:00100000:1.0:1784935589.805780:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784935589.805791:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292119040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935589.805822:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784935589.805870:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292119040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935589.805877:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784935589.805924:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292119040:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784935589.806195:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935589.806824:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292119424:0@lo:400:kworker.0 00000100:00100000:2.0:1784935589.806856:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292119168:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.806871:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935589.806901:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292119936:0@lo:400:kworker.0 00000100:00100000:2.0:1784935589.806906:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935589.806956:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935589.806960:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292119680:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.806978:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292120448:0@lo:400:kworker.0 00000100:00100000:2.0:1784935589.806999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935589.807009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935589.807022:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292120192:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807035:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784935589.807044:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292119552:0@lo:400:kworker.0 00000100:00100000:2.0:1784935589.807051:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935589.807081:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935589.807086:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784935589.807095:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292119296:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807103:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292120064:0@lo:400:kworker.0 00000100:00100000:2.0:1784935589.807141:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935589.807150:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935589.807163:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292119808:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807176:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292120576:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807205:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935589.807213:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935589.807238:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292120192 00000100:00100000:2.0:1784935589.807238:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292120320:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807245:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292120192 00000100:00100000:2.0:1784935589.807264:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935589.807293:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292120064 00000100:00100000:2.0:1784935589.807293:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292119936 00000100:00100000:2.0:1784935589.807298:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292119936 00000100:00100000:3.0:1784935589.807299:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292120064 00000100:00100000:3.0:1784935589.807319:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292120576 00000100:00100000:3.0:1784935589.807321:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292120576 00000100:00100000:2.0:1784935589.807333:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292120448 00000100:00100000:2.0:1784935589.807337:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292120448 00000100:00100000:3.0:1784935589.807345:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784935589.807355:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292120192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935589.807359:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292119552 00000100:00100000:2.0:1784935589.807363:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292119552 00000100:00100000:2.0:1784935589.807378:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292119296 00000100:00100000:2.0:1784935589.807380:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292119296 00000100:00100000:3.0:1784935589.807404:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292120192:12345-0@lo:400:kworker.0 Request processed in 51us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935589.807407:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292119808 00000100:00100000:2.0:1784935589.807411:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292119808 00000100:00100000:3.0:1784935589.807416:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784935589.807427:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292120320 00000100:00100000:2.0:1784935589.807431:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292120320 00000100:00100000:3.0:1784935589.807436:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784935589.807446:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292120064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935589.807461:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1784935589.807471:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292119936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807489:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292120064:12345-0@lo:400:kworker.0 Request processed in 46us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935589.807496:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784935589.807512:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784935589.807516:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292119936:12345-0@lo:400:kworker.0 Request processed in 45us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935589.807524:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292120576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935589.807530:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1784935589.807549:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1784935589.807558:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292120448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807565:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292120576:12345-0@lo:400:kworker.0 Request processed in 41us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935589.807572:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784935589.807601:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1784935589.807602:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292120448:12345-0@lo:400:kworker.0 Request processed in 43us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935589.807610:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292119552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935589.807612:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1784935589.807632:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1784935589.807649:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292119296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807661:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292119552:12345-0@lo:400:kworker.0 Request processed in 53us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935589.807669:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784935589.807687:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1784935589.807692:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292119296:12345-0@lo:400:kworker.0 Request processed in 43us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935589.807699:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292119808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935589.807705:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1784935589.807735:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292119808:12345-0@lo:400:kworker.0 Request processed in 39us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935589.807736:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1784935589.807746:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1784935589.807749:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292120320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807785:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292119296:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807795:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292119808:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807803:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292120192:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807830:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292119552:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807838:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292120064:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.807846:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292120576:0@lo:400:kworker.0 00010000:00080000:3.0:1784935589.807857:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574030a80 x1871640292119936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935589.807866:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292119936:0@lo:400:kworker.0 00010000:00080000:3.0:1784935589.807873:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574030000 x1871640292120448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935589.807881:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292120448:0@lo:400:kworker.0 00000100:00100000:2.0:1784935589.808703:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292120320:12345-0@lo:400:kworker.0 Request processed in 955us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935589.808711:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1784935589.809029:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292119424 00000100:00100000:0.0:1784935589.809035:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292119424 00000100:00100000:0.0:1784935589.809091:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292119680 00000100:00100000:0.0:1784935589.809095:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292119680 00000100:00100000:0.0:1784935589.809110:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1784935589.809117:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292119424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935589.809164:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292119424:12345-0@lo:400:kworker.0 Request processed in 47us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935589.809189:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1784935589.809203:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1784935589.809209:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292119680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935589.809238:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292119680:12345-0@lo:400:kworker.0 Request processed in 30us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935589.809255:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1784935589.809277:0:6518:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292119168 00000100:00100000:0.0:1784935589.809281:0:6518:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292119168 00000100:00100000:0.0:1784935589.809303:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1784935589.809310:0:6518:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292119168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935589.809341:0:6518:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292119168:12345-0@lo:400:kworker.0 Request processed in 32us (2438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935589.809347:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00080000:0.0:1784935589.809379:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784935589.809558:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784935589.809562:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935589.809564:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784935589.809601:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292119424:0@lo:400:kworker.0 00000100:00100000:1.0:1784935589.809683:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784935589.809712:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292120704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935589.809924:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935589.810472:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292120320:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.810514:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292119168:0@lo:400:kworker.0 00000100:00100000:3.0:1784935589.810526:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292119680:0@lo:400:kworker.0 00000100:00100000:0.0:1784935589.810633:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292120704 00000100:00100000:0.0:1784935589.810639:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292120704 00000100:00100000:0.0:1784935589.810682:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784935589.810691:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292120704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935589.810729:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935589.811040:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292120704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 349us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935589.811047:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784935589.811507:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292120704:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784935589.997675:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784935590.061297:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784935590.061308:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784935590.061465:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1784935590.061472:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784935590.078686:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935590.078845:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273204864 00000100:00100000:3.0:1784935590.078855:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273204864 00000100:00100000:3.0:1784935590.078955:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 66 00000100:00100000:3.0:1784935590.078967:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+18:13166:x1871640273204864:12345-192.168.203.28@tcp:35:umount.0 00000100:00100000:3.0:1784935590.079211:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+19:13166:x1871640273204864:12345-192.168.203.28@tcp:35:umount.0 Request processed in 247us (535us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1784935590.079219:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 66 00000100:00080000:0.0:1784935590.079337:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935590.086139:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935590.086233:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273205120 00000100:00100000:3.0:1784935590.086243:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273205120 00000100:00100000:3.0:1784935590.086297:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 67 00000100:00100000:3.0:1784935590.086307:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+19:13166:x1871640273205120:12345-192.168.203.28@tcp:35:umount.0 00000100:00100000:3.0:1784935590.086577:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+20:13166:x1871640273205120:12345-192.168.203.28@tcp:35:umount.0 Request processed in 271us (447us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1784935590.086584:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 67 00000100:00100000:2.0:1784935590.090408:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935590.090621:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273205376 00000100:00100000:3.0:1784935590.090630:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273205376 00000100:00100000:3.0:1784935590.090687:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 68 00000100:00100000:3.0:1784935590.090699:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4572a08050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+20:13166:x1871640273205376:12345-192.168.203.28@tcp:35:umount.0 00000100:00100000:3.0:1784935590.090963:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4572a08050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+21:13166:x1871640273205376:12345-192.168.203.28@tcp:35:umount.0 Request processed in 265us (562us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1784935590.090970:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 68 00000100:00100000:1.0:1784935590.095202:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935590.095566:0:6529:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273205632 00000100:00100000:3.0:1784935590.095588:0:6529:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273205632 00000100:00100000:3.0:1784935590.095645:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 69 00000100:00100000:3.0:1784935590.095655:0:6529:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+21:13166:x1871640273205632:12345-192.168.203.28@tcp:35:umount.0 00000100:00100000:3.0:1784935590.095975:0:6529:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+22:13166:x1871640273205632:12345-192.168.203.28@tcp:35:umount.0 Request processed in 320us (779us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1784935590.095983:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 69 00000100:00100000:0.0:1784935590.100391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935590.100431:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935590.100519:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273205760 00000100:00100000:2.0:1784935590.100529:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273205760 00000100:00100000:2.0:1784935590.100588:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273205888 00000100:00100000:2.0:1784935590.100591:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273205888 00000100:00100000:2.0:1784935590.100620:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:2.0:1784935590.100629:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:065c8aa1-ae1a-4743-85eb-344bf4a888c9+14:2391:x1871640273205760:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935590.100646:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935590.100664:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541528600/0x857e02f4e0b16570 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a836 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935590.100677:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935590.100723:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:065c8aa1-ae1a-4743-85eb-344bf4a888c9+13:2391:x1871640273205760:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 94us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935590.100740:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:2.0:1784935590.100773:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:2.0:1784935590.100779:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:2391:x1871640273205888:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935590.100787:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935590.100796:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541528a00/0x857e02f4e0b16531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a7f7 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935590.100804:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935590.100823:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:2391:x1871640273205888:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 44us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935590.100828:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:0.0:1784935590.104644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935590.105918:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273206016 00000100:00100000:2.0:1784935590.105952:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273206016 00000100:00100000:2.0:1784935590.106018:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:2.0:1784935590.106028:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:2393:x1871640273206016:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935590.106044:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784935590.106249:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00010000:00010000:2.0:1784935590.106318:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443699e00/0x857e02f4e0b16841 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a90f expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935590.106339:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935590.106579:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273206144 00000100:00100000:1.0:1784935590.106585:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273206144 00000100:00100000:1.0:1784935590.106670:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 80 00000100:00100000:1.0:1784935590.106679:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2390:x1871640273206144:12345-192.168.203.28@tcp:9:umount.0 00000020:00000080:1.0:1784935590.106703:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1690c 00000100:00080000:1.0:1784935590.106722:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784935590.106877:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:0.0:1784935590.107148:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784935590.107193:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935590.107329:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2393:x1871640273206016:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 1300us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935590.107329:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+2:2390:x1871640273206144:12345-192.168.203.28@tcp:9:umount.0 Request processed in 648us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935590.107337:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:1.0:1784935590.107337:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 80 00000100:00100000:0.0:1784935590.117325:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935590.117636:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273206528 00000100:00100000:3.0:1784935590.117646:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273206528 00000100:00100000:3.0:1784935590.117760:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 81 00000100:00100000:3.0:1784935590.117771:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2390:x1871640273206528:12345-192.168.203.28@tcp:9:umount.0 00000020:00000080:3.0:1784935590.117800:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16b7b 00000020:00010000:3.0:1784935590.117807:0:8440:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d4549f2d800: total 0 00000100:00080000:3.0:1784935590.117812:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8d4549f2d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784935590.117865:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1784935590.118049:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2390:x1871640273206528:12345-192.168.203.28@tcp:9:umount.0 Request processed in 280us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935590.118069:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 81 00000020:00010000:1.0:1784935590.118330:0:6513:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d4549f2d800: total 0 00010000:00010000:1.0:1784935590.118368:0:6513:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d4549f2d800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1784935590.118430:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b17609 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acdc expref: 4 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935590.118466:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b16f3a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaf9 expref: 3 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935590.118481:0:6513:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d4549f2d800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1784935590.118513:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935590.118515:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935590.118528:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784935590.122091:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784935590.127315:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935590.127407:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273207552 00000100:00100000:3.0:1784935590.127417:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273207552 00000100:00100000:3.0:1784935590.127588:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 258 00000100:00100000:3.0:1784935590.127600:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+22:2390:x1871640273207552:12345-192.168.203.28@tcp:39:umount.0 00000020:00000080:3.0:1784935590.127636:0:12375:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1653f 00000020:00010000:3.0:1784935590.127653:0:12375:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d4570c46800: total 0 00000100:00080000:3.0:1784935590.127658:0:12375:0:(import.c:65:import_set_state_nolock()) ffff8d457b98d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784935590.127684:0:12375:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:0.0:1784935590.127821:0:6514:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d4570c46800: total 0 00010000:00010000:0.0:1784935590.127825:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935590.127876:0:6514:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d4570c46800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1784935590.127908:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935590.127911:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784935590.127919:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699a00/0x857e02f4e0b16bdd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aa12 expref: 21 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.127969:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:0.0:1784935590.127972:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784935590.127976:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201400/0x857e02f4e0b174ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ac8f expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.127991:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935590.127993:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784935590.127997:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554020200/0x857e02f4e0b16e1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaac expref: 19 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.128008:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d454918d500) 00010000:00010000:0.0:1784935590.128010:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784935590.128014:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6c600/0x857e02f4e0b1686b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a91d expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.128045:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:0.0:1784935590.128048:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784935590.128078:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443699400/0x857e02f4e0b16fbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab1c expref: 17 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.128094:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:0.0:1784935590.128096:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935590.128099:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b175ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acc7 expref: 16 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.128110:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d45705a8900) 00010000:00010000:0.0:1784935590.128112:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784935590.128115:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201000/0x857e02f4e0b175f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acd5 expref: 15 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.128128:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d45705a8300) 00010000:00010000:0.0:1784935590.128129:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784935590.128132:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698800/0x857e02f4e0b168e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a939 expref: 14 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.128143:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d44429bb400) 00010000:00010000:0.0:1784935590.128145:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784935590.128148:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9400/0x857e02f4e0b172ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313abf5 expref: 13 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.128160:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d44429bbe00) 00010000:00010000:0.0:1784935590.128162:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784935590.128165:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443200c00/0x857e02f4e0b16fa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ab15 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.128176:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d454918dc00) 00010000:00010000:0.0:1784935590.128182:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935590.128186:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4442a6de00/0x857e02f4e0b16887 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a924 expref: 11 pid: 7797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.128200:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935590.128201:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935590.128204:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443201200/0x857e02f4e0b16efb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aae4 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.128214:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d454742eb00) 00010000:00010000:0.0:1784935590.128216:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784935590.128219:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9a00/0x857e02f4e0b16f25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aaf2 expref: 9 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935590.128229:0:6514:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d4570c46800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1784935590.128242:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935590.128243:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935590.128245:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935590.128571:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:380c344d-145d-4a03-bcd4-797f2a6954a7+7:2390:x1871640273207552:12345-192.168.203.28@tcp:39:umount.0 Request processed in 972us (1263us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1784935590.128589:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 258 00000100:00100000:3.0:1784935590.136555:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935590.136681:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273207680 00000100:00100000:2.0:1784935590.136690:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273207680 00000100:00100000:2.0:1784935590.136905:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 259 00000100:00100000:2.0:1784935590.136915:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+5:2390:x1871640273207680:12345-192.168.203.28@tcp:39:umount.0 00000020:00000080:2.0:1784935590.136979:0:6525:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16546 00000100:00080000:2.0:1784935590.137008:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8d457e89a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784935590.137027:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784935590.137189:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:380c344d-145d-4a03-bcd4-797f2a6954a7+3:2390:x1871640273207680:12345-192.168.203.28@tcp:39:umount.0 Request processed in 275us (645us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784935590.137196:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 259 00010000:00010000:1.0:1784935590.137879:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784935590.141590:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784935590.317426:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292120832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935590.317499:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935590.317694:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292120832 00000100:00100000:2.0:1784935590.317703:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292120832 00000100:00100000:2.0:1784935590.317836:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784935590.317846:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292120832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784935590.317877:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784935590.317949:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292120832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935590.317956:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784935590.318050:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292120832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935590.318354:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292120960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935590.318383:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935590.318459:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292120960 00000100:00100000:0.0:1784935590.318464:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292120960 00000100:00100000:0.0:1784935590.318497:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784935590.318504:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292120960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784935590.318515:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784935590.318554:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292120960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935590.318560:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784935590.318625:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292120960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935590.569171:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935590.569216:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935590.569450:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273207808 00000100:00100000:2.0:1784935590.569451:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273207936 00000100:00100000:2.0:1784935590.569463:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273207936 00000100:00100000:1.0:1784935590.569463:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273207808 00000100:00080000:0.0:1784935590.569541:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935590.569546:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935590.569551:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 342 00000100:00100000:2.0:1784935590.569563:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273207936:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935590.569647:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:372b228c-57a7-4786-b20d-41f2845c5abd+5:2394:x1871640273207936:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 86us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935590.569656:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 343 00000100:00100000:1.0:1784935590.569732:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+6:2394:x1871640273207808:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935590.569764:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:372b228c-57a7-4786-b20d-41f2845c5abd+6:2394:x1871640273207808:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 100us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935590.573659:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 342 00000100:00100000:1.0:1784935590.576636:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 343 00000100:00100000:0.0:1784935590.829145:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292121088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935590.829219:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935590.829345:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292121088 00000100:00100000:1.0:1784935590.829355:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292121088 00000100:00100000:1.0:1784935590.829413:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784935590.829423:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292121088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784935590.829457:0:10724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784935590.829667:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292121088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 244us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935590.829676:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1784935590.829679:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292121088:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1784935590.896386:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784935591.021863:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935591.870916:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935591.870993:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935591.871037:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935591.871160:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273208064 00000100:00100000:3.0:1784935591.871170:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273208064 00000100:00100000:2.0:1784935591.871206:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273208320 00000100:00100000:2.0:1784935591.871221:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273208320 00000100:00100000:3.0:1784935591.871235:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273208192 00000100:00100000:3.0:1784935591.871241:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273208192 00000100:00100000:2.0:1784935591.871256:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:2.0:1784935591.871267:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+12:2394:x1871640273208064:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935591.871408:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935591.871428:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4442a6dc00/0x857e02f4e0b16642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a84b expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935591.871457:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935591.871512:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:2394:x1871640273208064:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 247us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935591.871985:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:3.0:1784935591.871996:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566e69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+11:2394:x1871640273208320:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935591.872006:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935591.877008:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443698200/0x857e02f4e0b1682c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a908 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935591.877031:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935591.877103:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566e69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+10:2394:x1871640273208320:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 5108us (6109us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935591.877113:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:3.0:1784935591.877664:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:3.0:1784935591.877678:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+9:2394:x1871640273208192:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784935591.877711:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935591.877726:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541529a00/0x857e02f4e0b16649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a87c expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935591.877739:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935591.877761:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:065c8aa1-ae1a-4743-85eb-344bf4a888c9+8:2394:x1871640273208192:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 89us (6725us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935591.877767:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:1.0:1784935591.889300:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935591.889377:0:6527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273208576 00000100:00100000:3.0:1784935591.889386:0:6527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273208576 00000100:00100000:3.0:1784935591.889442:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 260 00000100:00100000:3.0:1784935591.889451:0:6527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+6:2390:x1871640273208576:12345-192.168.203.28@tcp:39:umount.0 00000020:00000080:3.0:1784935591.889487:0:6527:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16657 00000020:00010000:3.0:1784935591.889495:0:6527:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d444355c000: total 0 00000100:00080000:3.0:1784935591.889499:0:6527:0:(import.c:65:import_set_state_nolock()) ffff8d444355f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784935591.889525:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1784935591.889666:0:6527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:372b228c-57a7-4786-b20d-41f2845c5abd+5:2390:x1871640273208576:12345-192.168.203.28@tcp:39:umount.0 Request processed in 216us (374us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1784935591.889673:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 260 00000020:00010000:1.0:1784935591.890018:0:6513:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d444355c000: total 0 00010000:00010000:1.0:1784935591.890072:0:6513:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d444355c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784935591.890106:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d44429bbe00) 00010000:00010000:1.0:1784935591.890110:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784935591.890118:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4443698400/0x857e02f4e0b17617 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ace3 expref: 4 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935591.890150:0:6513:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d444355c000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784935591.890172:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935591.890174:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935591.890176:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935591.892027:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:3.0:1784935591.902463:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935591.902568:0:6525:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273208704 00000100:00100000:0.0:1784935591.902578:0:6525:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273208704 00000100:00100000:0.0:1784935591.902646:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 261 00000100:00100000:0.0:1784935591.902657:0:6525:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+5:2390:x1871640273208704:12345-192.168.203.28@tcp:39:umount.0 00000020:00000080:0.0:1784935591.902697:0:6525:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1665e 00000100:00080000:0.0:1784935591.902707:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8d457d2a7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784935591.902736:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1784935591.902892:0:6525:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:372b228c-57a7-4786-b20d-41f2845c5abd+3:2390:x1871640273208704:12345-192.168.203.28@tcp:39:umount.0 Request processed in 237us (439us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784935591.902899:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 261 00010000:00010000:3.0:1784935591.903416:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935591.962967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935591.963066:0:6517:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273208960 00000100:00100000:2.0:1784935591.963075:0:6517:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273208960 00000100:00100000:2.0:1784935591.963128:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 391 00000100:00100000:2.0:1784935591.963321:0:6517:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+7:2390:x1871640273208960:12345-192.168.203.28@tcp:251:umount.0 00000020:00000080:2.0:1784935591.963368:0:6517:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1651c 00000020:00010000:2.0:1784935591.963376:0:6517:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d4443395800: total 0 00000100:00080000:2.0:1784935591.963380:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8d4443394800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1784935591.963499:0:6513:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d4443395800: total 0 00010000:00010000:1.0:1784935591.963503:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935591.963550:0:6513:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d4443395800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784935591.963581:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540031c00/0x857e02f4e0b16577 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313a83d expref: 3 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935591.963596:0:6513:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d4443395800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784935591.963604:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935591.963606:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935591.963607:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935591.963656:0:6517:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:065c8aa1-ae1a-4743-85eb-344bf4a888c9+1:2390:x1871640273208960:12345-192.168.203.28@tcp:251:umount.0 Request processed in 519us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935591.963664:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 391 00000020:00000080:2.0:1784935591.963674:0:6517:0:(genops.c:906:class_export_put()) final put ffff8d4443395800/065c8aa1-ae1a-4743-85eb-344bf4a888c9 00000020:00000080:0.0:1784935591.963888:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4443395800/065c8aa1-ae1a-4743-85eb-344bf4a888c9 for MGS 00000020:00000080:0.0:1784935591.963922:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4443394800 for MGS 00010000:00010000:3.0:1784935592.045368:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935593.069010:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935593.393116:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935593.393141:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292121216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784935593.393208:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935593.393399:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292121216 00000100:00100000:1.0:1784935593.393408:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292121216 00000100:00100000:1.0:1784935593.393465:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1784935593.393475:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292121216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784935593.393512:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1784935593.393565:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292121216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935593.393573:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1784935593.394775:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292121216:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1784935593.616492:0:15209:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784935593.633127:0:15209:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784935593.633179:0:15209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.633192:0:15209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.633200:0:15209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.633207:0:15209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.633238:0:15209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784935593.633244:0:15209:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784935593.633270:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784935593.633274:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784935593.633279:0:15209:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784935593.633302:0:15209:0:(import.c:65:import_set_state_nolock()) ffff8d4570df7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1784935593.634188:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935593.634197:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935593.634206:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166b800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:3.0:1784935593.634219:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935593.634229:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935593.634236:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935593.634241:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784935593.634243:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784935593.634246:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784935593.634973:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935593.634983:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784935593.640178:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871640292121344:0@lo:39:umount.0 00000100:00100000:0.0:1784935593.640252:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784935593.640761:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935593.640774:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166b800/0x857e02f4e0b16603 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b1660a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935593.640792:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935593.640794:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935593.640796:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935593.642019:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935593.642052:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292121472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935593.642111:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935593.643630:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292121344 00000100:00100000:1.0:1784935593.643643:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292121344 00000100:00100000:1.0:1784935593.643708:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1784935593.643717:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871640292121344:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784935593.643747:0:6526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16141 00000100:00080000:1.0:1784935593.643755:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8d4581ebc000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784935593.643842:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3648:x1871640292121344:12345-0@lo:39:umount.0 Request processed in 125us (3591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935593.643863:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1784935593.643872:0:6526:0:(genops.c:906:class_export_put()) final put ffff8d4581ebd000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1784935593.644376:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784935593.644456:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4570df7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784935593.644474:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871640292121344:0@lo:39:umount.0 00000100:00100000:0.0:1784935593.644517:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292121472 00000100:00100000:0.0:1784935593.644521:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292121472 00000100:00100000:0.0:1784935593.644558:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784935593.644564:0:6512:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3649:x1871640292121472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784935593.644574:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935593.644590:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166a200/0x857e02f4e0b1660a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b16603 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935593.644606:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935593.644641:0:6512:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:3649:x1871640292121472:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935593.644648:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784935593.644678:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292121472:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1784935593.644730:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784935593.644734:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784935593.644738:0:15209:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784935593.646558:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4581ebd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784935593.646606:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4581ebc000 for lustre-MDT0000 00010000:00010000:2.0:1784935593.648152:0:15209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.648169:0:15209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.648176:0:15209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.648182:0:15209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.648212:0:15209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784935593.648218:0:15209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.648236:0:15209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.648241:0:15209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.648247:0:15209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.648260:0:15209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784935593.648266:0:15209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.649093:0:15209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.649102:0:15209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.649108:0:15209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.649118:0:15209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784935593.649123:0:15209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a400/0x857e02f4e0b16092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.649129:0:15209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a400/0x857e02f4e0b16092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.649146:0:15209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a400/0x857e02f4e0b16092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.649152:0:15209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d454166a400/0x857e02f4e0b16092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935593.649157:0:15209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1784935593.649160:0:15209:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1784935593.649192:0:15209:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784935593.649195:0:15209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1784935593.649199:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935593.649204:0:15209:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1784935593.649210:0:15209:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8d44430bf800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784935593.649215:0:15209:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8d457d0fe000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784935593.649219:0:15209:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8d4570df4000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784935593.649223:0:15209:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8d457b964800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1784935593.649230:0:15209:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8d444355c000 372b228c-57a7-4786-b20d-41f2845c5abd 192.168.203.28@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784935593.649235:0:15209:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8d4570c46800 380c344d-145d-4a03-bcd4-797f2a6954a7 192.168.203.28@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1784935593.649240:0:15209:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8d4572a399c0) has exports, disconnecting them 00000020:00080000:2.0:1784935593.649244:0:15209:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d44430bf800), last request at 1784935589 00000020:00000080:2.0:1784935593.649251:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16443 00000100:00080000:2.0:1784935593.649268:0:15209:0:(import.c:65:import_set_state_nolock()) ffff8d44430ba000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784935593.649379:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784935593.649386:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649394:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6c000 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935593.649398:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649406:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935593.649414:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935593.649419:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784935593.649422:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1784935593.649424:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1784935593.649456:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649461:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935593.649485:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649492:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c000/0x857e02f4e0b16611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16618 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649504:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784935593.649512:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649517:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301c00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935593.649520:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649526:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935593.649531:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935593.649536:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1784935593.649538:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1784935593.649540:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784935593.649550:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649554:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935593.649559:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649565:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d301c00/0x857e02f4e0b164d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b164dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649572:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784935593.649574:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649579:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4442a6c800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935593.649585:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649592:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935593.649597:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935593.649601:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784935593.649603:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784935593.649604:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784935593.649613:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649617:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935593.649625:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649630:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4442a6c800/0x857e02f4e0b16833 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b1683a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649637:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784935593.649640:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166a400/0x857e02f4e0b16092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649645:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166a400 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935593.649647:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166a400/0x857e02f4e0b16092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649652:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166a400/0x857e02f4e0b16092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935593.649661:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166a400/0x857e02f4e0b16092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935593.649666:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1784935593.649668:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1784935593.649669:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1784935593.649677:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166a400/0x857e02f4e0b16092 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649682:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935593.649686:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166a400/0x857e02f4e0b16092 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649691:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166a400/0x857e02f4e0b16092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16099 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935593.649698:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935593.649700:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935593.649701:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935593.649752:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784935593.649842:0:15209:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d44430bf800): rc 0 00000020:00000080:2.0:1784935593.649845:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d44430bf800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1784935593.649864:0:15209:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d457d0fe000), last request at 1784935589 00000020:00000080:2.0:1784935593.649874:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1631d 00000100:00080000:2.0:1784935593.649880:0:15209:0:(import.c:65:import_set_state_nolock()) ffff8d44421b6000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784935593.649891:0:15209:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d457d0fe000): rc 0 00000020:00000080:2.0:1784935593.649893:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d457d0fe000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1784935593.649897:0:15209:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d4570df4000), last request at 1784935378 00000020:00000080:2.0:1784935593.649900:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1621a 00000100:00080000:2.0:1784935593.649903:0:15209:0:(import.c:65:import_set_state_nolock()) ffff8d4570df0800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784935593.649908:0:15209:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d4570df4000): rc 0 00000020:00000080:2.0:1784935593.649910:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d4570df4000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1784935593.649913:0:15209:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d457b964800), last request at 1784935378 00000020:00000080:2.0:1784935593.649915:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b161db 00000100:00080000:2.0:1784935593.649918:0:15209:0:(import.c:65:import_set_state_nolock()) ffff8d4581cd7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784935593.649923:0:15209:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:0.0:1784935593.650110:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292121600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935593.650170:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935593.650210:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784935593.650215:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292121728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935593.650230:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935593.650252:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292121856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784935593.650779:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784935593.650827:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44430bf800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1784935593.650885:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d0fe000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784935593.650909:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4570df4000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1784935593.650953:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d44430ba000 for lustre-MDT0000 00000020:00000080:3.0:1784935593.650959:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d44421b6000 for lustre-MDT0000 00000020:00000080:3.0:1784935593.650970:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4570df0800 for lustre-MDT0000 00010000:00010000:3.0:1784935593.650978:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784935593.651121:0:15209:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d457b964800): rc 0 00000004:00000080:2.0:1784935593.651127:0:15209:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadd447987ae0 00000100:00080000:2.0:1784935593.651143:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784935593.651147:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1784935593.652164:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292121984:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1784935593.652268:0:15209:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784935593.652297:0:15209:0:(import.c:65:import_set_state_nolock()) ffff8d457d0fa000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784935593.652436:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784935593.652440:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1784935593.652452:0:15209:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784935593.652517:0:15209:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784935593.652526:0:15209:0:(import.c:65:import_set_state_nolock()) ffff8d457e89e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784935593.652531:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784935593.652533:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1784935593.652539:0:15209:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784935593.652593:0:15209:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784935593.652609:0:15209:0:(import.c:65:import_set_state_nolock()) ffff8d4443393800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1784935593.652640:0:15209:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8d4572a399c0) has no exports 00000100:00100000:1.0:1784935593.652763:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292122112:0@lo:39:umount.0 00000100:00100000:3.0:1784935593.652896:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935593.653191:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935593.653215:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292122240:0@lo:9:umount.0 00000100:00100000:1.0:1784935593.653235:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935593.653249:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292122368:0@lo:9:umount.0 00000100:00100000:1.0:1784935593.653263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935593.653301:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292122240 00000100:00100000:1.0:1784935593.653307:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292122240 00000100:00100000:1.0:1784935593.653359:0:8439:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292122368 00000100:00100000:1.0:1784935593.653362:0:8439:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292122368 00000100:00100000:1.0:1784935593.653382:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784935593.653389:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871640292122240:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784935593.653416:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b163c5 00000100:00080000:1.0:1784935593.653423:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8d457d0ff800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784935593.653455:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1784935593.653553:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3648:x1871640292122240:12345-0@lo:9:umount.0 Request processed in 164us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935593.653560:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784935593.653574:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784935593.653580:0:8439:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871640292122368:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784935593.653592:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16507 00000100:00080000:1.0:1784935593.653597:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8d44428f3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784935593.653615:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1784935593.653676:0:8439:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3648:x1871640292122368:12345-0@lo:9:umount.0 Request processed in 95us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935593.653682:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1784935593.653716:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d457e89e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784935593.653726:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784935593.653728:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784935593.653730:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292122240:0@lo:9:umount.0 00000100:00080000:1.0:1784935593.653740:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4443393800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784935593.653745:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784935593.653747:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784935593.653749:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292122368:0@lo:9:umount.0 00010000:00010000:1.0:1784935593.653774:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935593.653871:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292122112 00000100:00100000:3.0:1784935593.653885:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292122112 00000100:00100000:3.0:1784935593.653919:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1784935593.653948:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871640292122112:12345-0@lo:39:umount.0 00000020:00000080:3.0:1784935593.653965:0:10724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16275 00000100:00080000:3.0:1784935593.653970:0:10724:0:(import.c:65:import_set_state_nolock()) ffff8d4573f8e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784935593.653985:0:10724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1784935593.654094:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3648:x1871640292122112:12345-0@lo:39:umount.0 Request processed in 168us (902us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784935593.654100:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00010000:3.0:1784935593.654117:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784935593.654132:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d457d0fa000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784935593.654136:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292122112:0@lo:39:umount.0 00010000:00010000:3.0:1784935593.654144:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935593.654165:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292121600 00000100:00100000:3.0:1784935593.654168:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292121600 00000100:00100000:3.0:1784935593.654191:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292121728 00000100:00100000:3.0:1784935593.654193:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292121728 00000100:00100000:3.0:1784935593.654202:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292121984 00000100:00100000:3.0:1784935593.654204:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292121984 00000100:00100000:3.0:1784935593.654214:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784935593.654218:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+25:3651:x1871640292121600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935593.654226:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935593.654241:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4442a6c400/0x857e02f4e0b16618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b16611 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935593.654262:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935593.654480:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+24:3651:x1871640292121600:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (4308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935593.654486:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784935593.654498:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784935593.654503:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+23:3651:x1871640292121728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935593.654509:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935593.654517:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166b000/0x857e02f4e0b164dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b164d6 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935593.654527:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935593.654544:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+22:3651:x1871640292121728:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (4313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935593.654549:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784935593.654558:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784935593.654562:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+21:3650:x1871640292121984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935593.654568:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935593.654575:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540030000/0x857e02f4e0b16099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b16092 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935593.654582:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935593.654601:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3650:x1871640292121984:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935593.654606:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784935593.654631:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292121984:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1784935593.654656:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784935593.654671:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935593.654708:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292121728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935593.654709:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935593.654716:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3651:1871640292121600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784935593.654738:0:6510:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292121856 00000100:00100000:3.0:1784935593.654741:0:6510:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292121856 00000100:00100000:3.0:1784935593.654768:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784935593.654775:0:6510:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+20:3649:x1871640292121856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935593.654782:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935593.654790:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4442a6c200/0x857e02f4e0b1683a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b16833 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935593.654800:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935593.654829:0:6510:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:3649:x1871640292121856:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935593.654835:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784935593.654941:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292121856:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1784935593.664315:0:15209:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8d4572a399c0) has no exports 00000020:00000080:2.0:1784935593.721564:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b160ed 00000020:00000080:2.0:1784935593.721578:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d4581cd3000/lustre-QMT0000_UUID 00000020:01000000:2.0:1784935593.721599:0:15209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1784935593.721659:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784935593.721669:0:15209:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784935593.721673:0:15209:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8d4581c93380) has no exports 00000020:00000080:1.0:1784935593.721704:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4581cd3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784935593.725616:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b160e6 00000020:00000080:2.0:1784935593.725632:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d4581c88800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784935593.725705:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4581c88800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784935593.725781:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935593.725792:0:15209:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784935593.725796:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d4581c8b800/lustre-QMT0000_UUID 00000020:00000080:2.0:1784935593.725798:0:15209:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4581c8b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784935593.725806:0:15209:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1784935594.095148:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935594.925669:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292122624:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.925733:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935594.925813:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292123136:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.925838:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935594.925869:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784935594.925875:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292122496:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.925903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935594.925924:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292123008:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.925966:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935594.925985:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292123520:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926031:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935594.926061:0:6520:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292122496 00000100:00100000:1.0:1784935594.926068:0:6520:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292122496 00000100:00100000:1.0:1784935594.926113:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1784935594.926121:0:6520:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:3652:x1871640292122496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926183:0:6520:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d456defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6dcb3e6c-7883-4388-9dd1-46646343e0f5+19:3652:x1871640292122496:12345-0@lo:400:kworker.0 Request processed in 62us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935594.926191:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1784935594.926221:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292123008 00000100:00100000:1.0:1784935594.926225:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292123008 00000100:00100000:1.0:1784935594.926255:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1784935594.926261:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292123008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926292:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292123008:12345-0@lo:400:kworker.0 Request processed in 31us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935594.926298:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1784935594.926339:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292123136 00000100:00100000:1.0:1784935594.926343:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292123136 00000100:00100000:1.0:1784935594.926367:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292123520 00000100:00100000:1.0:1784935594.926370:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292123520 00000100:00100000:1.0:1784935594.926389:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784935594.926395:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292123136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926427:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292123136:12345-0@lo:400:kworker.0 Request processed in 33us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935594.926434:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784935594.926446:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784935594.926452:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292123520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926477:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292123520:12345-0@lo:400:kworker.0 Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935594.926483:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784935594.926514:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292122496:0@lo:400:kworker.0 00010000:00080000:1.0:1784935594.926527:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443daf800 x1871640292123008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935594.926537:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292123008:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926545:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292123520:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926553:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292123136:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926597:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292122752:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926621:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935594.926638:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292123264:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926655:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935594.926678:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784935594.926684:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292122880:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926703:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935594.926717:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292123392:0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926732:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935594.926752:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292122752 00000100:00100000:1.0:1784935594.926755:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292122752 00000100:00100000:1.0:1784935594.926770:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292123264 00000100:00100000:1.0:1784935594.926773:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292123264 00000100:00100000:1.0:1784935594.926779:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292122880 00000100:00100000:1.0:1784935594.926781:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292122880 00000100:00100000:1.0:1784935594.926788:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292123392 00000100:00100000:1.0:1784935594.926790:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292123392 00000100:00100000:1.0:1784935594.926804:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1784935594.926810:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292123392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935594.926843:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292123392:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935594.926849:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1784935594.926861:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1784935594.926865:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1871640292122752:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784935594.926870:0:12375:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784935594.926895:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1871640292122752:12345-0@lo:400:kworker.0 Request processed in 28us (273us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784935594.926901:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1784935594.926911:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1784935594.926915:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1871640292123264:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784935594.926919:0:12375:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784935594.926968:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1871640292123264:12345-0@lo:400:kworker.0 Request processed in 52us (312us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784935594.926981:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1784935594.926993:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784935594.926997:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1871640292122880:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784935594.927002:0:12375:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784935594.927037:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1871640292122880:12345-0@lo:400:kworker.0 Request processed in 37us (332us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784935594.927043:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1784935594.927070:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784935594.927075:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8d457d24c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784935594.927078:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1784935594.930615:0:6530:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292122624 00000100:00100000:3.0:1784935594.930629:0:6530:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292122624 00000100:00100000:3.0:1784935594.930693:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1784935594.930700:0:6530:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1871640292122624:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784935594.930709:0:6530:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784935594.930796:0:6530:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1871640292122624:12345-0@lo:400:kworker.0 Request processed in 95us (5061us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784935594.930812:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1784935594.930834:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784935594.930851:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784935594.930855:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784935594.930895:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784935594.930900:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8d4573e1e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784935594.930904:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784935594.930910:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8d4573e1e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784935594.930914:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 197 00000100:00080000:3.0:1784935594.930920:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d4573e1e000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935594.930977:0:3652:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574004380 x1871640292123648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784935594.931002:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292122624:0@lo:400:kworker.0 00000100:00100000:3.0:1784935594.931041:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292123648:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784935594.931076:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935594.931110:0:6531:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292123648 00000100:00100000:3.0:1784935594.931115:0:6531:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292123648 00000100:00100000:3.0:1784935594.931147:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1784935594.931151:0:6531:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1871640292123648:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1784935594.931165:0:6531:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1784935594.932793:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292123776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935594.932865:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935594.933167:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292123776 00000100:00100000:0.0:1784935594.933175:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292123776 00000100:00100000:0.0:1784935594.933555:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784935594.933564:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292123776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935594.933594:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935594.933682:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292123776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935594.933689:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784935594.934015:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292123776:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784935594.966285:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8d457d24c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935594.966295:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 214 00000100:00080000:1.0:1784935594.966305:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d457d24c800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935594.966373:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443d32a00 x1871640292123904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784935594.966466:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1871640292123904:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784935594.966531:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935594.966880:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292122880:0@lo:400:kworker.0 00010000:00080000:1.0:1784935594.966908:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443daf480 x1871640292123392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935594.966920:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292123392:0@lo:400:kworker.0 00000100:00080000:1.0:1784935594.966966:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784935594.966970:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8d4573f8c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784935594.966974:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784935594.966978:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8d4573f8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784935594.967097:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292123904 00000100:00100000:0.0:1784935594.967104:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292123904 00000100:00100000:0.0:1784935594.967155:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1784935594.967162:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1871640292123904:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1784935594.967178:0:12375:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1784935594.968064:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 197 00000100:00080000:1.0:1784935594.968071:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d4573f8c800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935594.968099:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443d30a80 x1871640292124032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784935594.973129:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871640292124032:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784935594.973212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935594.973315:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1871640292123904:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 6149us (6781us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784935594.973325:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1784935594.973350:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292124032 00000100:00100000:0.0:1784935594.973358:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292124032 00000100:00100000:0.0:1784935594.973390:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1784935594.973397:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1871640292124032:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1784935594.973415:0:12375:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784935594.973456:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1871640292124032:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 58us (243us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784935594.973463:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784935594.985128:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292122752:0@lo:400:kworker.0 00000100:00080000:0.0:1784935594.986640:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784935594.986658:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8d44430bd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784935594.986663:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784935594.986668:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8d44430bd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784935594.986672:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 233 00000100:00080000:0.0:1784935594.986679:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d44430bd800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:0.0:1784935594.986709:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443430700 x1871640292124160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935594.986726:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292123264:0@lo:400:kworker.0 00000100:00080000:2.0:1784935594.986852:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d457d24c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935594.986857:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784935594.986860:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1871640292123904:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784935594.986881:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1871640292124160:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784935594.986956:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784935594.987016:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4573f8c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935594.987037:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784935594.987040:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871640292124032:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784935594.987532:0:6526:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292124160 00000100:00100000:0.0:1784935594.987540:0:6526:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292124160 00000100:00100000:0.0:1784935594.987583:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784935594.987590:0:6526:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1871640292124160:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1784935594.987606:0:6526:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784935594.987663:0:6526:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1871640292124160:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 71us (706us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784935594.987670:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1784935594.988304:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44430bd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935594.988309:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784935594.988313:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1871640292124160:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784935594.995956:0:6531:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1871640292123648:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 64795us (64871us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784935594.995970:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1784935594.996482:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4573e1e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935594.996488:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784935594.996492:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292123648:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1784935595.117139:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935595.437886:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292124288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935595.437975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935595.438182:0:8443:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292124288 00000100:00100000:3.0:1784935595.438191:0:8443:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292124288 00000100:00100000:3.0:1784935595.438239:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784935595.438249:0:8443:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292124288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784935595.438289:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1784935595.438346:0:8443:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292124288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935595.438352:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784935595.439140:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292124288:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1784935595.953171:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784935595.953180:0:9518:0:(genops.c:906:class_export_put()) final put ffff8d44428f1000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784935595.953200:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:0.0:1784935595.953202:0:9518:0:(genops.c:906:class_export_put()) final put ffff8d455126d800/380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:1.0:1784935595.954048:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44428f1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1784935595.954111:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d455126d800/380c344d-145d-4a03-bcd4-797f2a6954a7 for lustre-OST0001 00000020:00000080:1.0:1784935595.954127:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d44428f3800 for lustre-OST0001 00000020:00000080:1.0:1784935595.954131:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d455126f800 for lustre-OST0001 00000001:00100000:0.0:1784935595.955902:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784935595.955911:0:6504:0:(genops.c:906:class_export_put()) final put ffff8d457b964800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1784935595.955960:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 372b228c-57a7-4786-b20d-41f2845c5abd 00000001:00080000:0.0:1784935595.955970:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1784935595.955974:0:6504:0:(genops.c:906:class_export_put()) final put ffff8d444355c000/372b228c-57a7-4786-b20d-41f2845c5abd 00000001:00100000:0.0:1784935595.955994:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000001:00080000:0.0:1784935595.955998:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1784935595.956006:0:6504:0:(genops.c:906:class_export_put()) final put ffff8d4570c46800/380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:2.0:1784935595.956053:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457b964800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1784935595.956112:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d444355c000/372b228c-57a7-4786-b20d-41f2845c5abd for lustre-MDT0000 00000020:00000080:2.0:1784935595.956131:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4570c46800/380c344d-145d-4a03-bcd4-797f2a6954a7 for lustre-MDT0000 00000020:00000080:2.0:1784935595.956163:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4581cd7000 for lustre-MDT0000 00000020:00000080:2.0:1784935595.956167:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d444355f000 for lustre-MDT0000 00000020:00000080:2.0:1784935595.956170:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d457b98d800 for lustre-MDT0000 00000001:00100000:3.0:1784935595.956627:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784935595.956636:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1784935595.956639:0:7456:0:(genops.c:906:class_export_put()) final put ffff8d457b967000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784935595.956655:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 372b228c-57a7-4786-b20d-41f2845c5abd 00000001:00080000:3.0:1784935595.956661:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1784935595.956663:0:7456:0:(genops.c:906:class_export_put()) final put ffff8d457d2a6800/372b228c-57a7-4786-b20d-41f2845c5abd 00000001:00100000:3.0:1784935595.956668:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000001:00080000:3.0:1784935595.956672:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1784935595.956674:0:7456:0:(genops.c:906:class_export_put()) final put ffff8d457b98e800/380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:1.0:1784935595.956702:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457b967000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1784935595.956746:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d2a6800/372b228c-57a7-4786-b20d-41f2845c5abd for lustre-MDT0001 00000020:00000080:1.0:1784935595.956767:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457b98e800/380c344d-145d-4a03-bcd4-797f2a6954a7 for lustre-MDT0001 00000020:00000080:1.0:1784935595.956785:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4573f8e000 for lustre-MDT0001 00000020:00000080:1.0:1784935595.956789:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d457d2a7000 for lustre-MDT0001 00000020:00000080:1.0:1784935595.956794:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d457e89a800 for lustre-MDT0001 00000001:00100000:1.0:1784935595.957518:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784935595.957523:0:8431:0:(genops.c:906:class_export_put()) final put ffff8d457d0fd000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784935595.957546:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:1.0:1784935595.957548:0:8431:0:(genops.c:906:class_export_put()) final put ffff8d4549f2d800/380c344d-145d-4a03-bcd4-797f2a6954a7 00000020:00000080:2.0:1784935595.957622:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d0fd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1784935595.957660:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4549f2d800/380c344d-145d-4a03-bcd4-797f2a6954a7 for lustre-OST0000 00000020:00000080:2.0:1784935595.957675:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d457d0ff800 for lustre-OST0000 00000020:00000080:2.0:1784935595.957679:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4549f2d000 for lustre-OST0000 00010000:00010000:3.0:1784935596.142681:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935597.165172:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935598.189234:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935599.213288:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1784935599.789079:0:15209:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d444333df00 - data ffff8d455e735288/ffff8d4443207c00 00000020:01000000:0.0:1784935599.789308:0:15209:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d4572acb2a0 - data ffff8d455e47de58/ffff8d457051f800 00000001:00000004:0.0:1784935599.801569:0:15209:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1784935599.865084:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784935599.865093:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1784935599.865107:0:15209:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8d4443599880 x1871640292122112/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784935603 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935599.865361:0:15209:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784935599.868064:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784935599.868071:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1784935599.868144:0:15209:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784935599.868147:0:15209:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784935599.871091:0:8984:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784935599.871098:0:8984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1784935599.871109:0:8984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1784935599.872147:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784935599.872152:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1784935599.872256:0:15209:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784935599.872260:0:15209:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784935599.873297:0:9958:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784935599.873308:0:9958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1784935599.873326:0:9958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1784935599.876000:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b160b5 00000020:00000080:2.0:1784935599.876012:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d45705cc000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784935599.876791:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d45705cc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784935599.878623:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b160ca 00000020:00000080:2.0:1784935599.878633:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d45705c9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784935599.878704:0:15209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1784935599.878710:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935599.878718:0:15209:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784935599.878722:0:15209:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8d4572a38000) has no exports 00000004:01000000:2.0:1784935599.878869:0:15209:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784935599.878876:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16500 00000020:00000080:2.0:1784935599.878879:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d44430bb000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784935599.878883:0:15209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784935599.878885:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935599.878893:0:15209:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784935599.878895:0:15209:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff8d457e888000) has no exports 00000020:00000080:2.0:1784935599.878900:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b164f9 00000020:00000080:2.0:1784935599.878903:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d4443391000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784935599.878994:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d45705c9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1784935599.879003:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44430bb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784935599.879007:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4443391000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784935599.880086:0:15209:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784935599.880092:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784935599.880095:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1784935599.880101:0:15209:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784935599.880103:0:15209:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784935599.880158:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935599.880167:0:15209:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784935599.880173:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b163be 00000020:00000080:2.0:1784935599.880179:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d457e89c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784935599.880184:0:15209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784935599.880187:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935599.880192:0:15209:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784935599.880194:0:15209:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff8d457e8899c0) has no exports 00000020:00000080:2.0:1784935599.880199:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b163b7 00000020:00000080:2.0:1784935599.880201:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d457e899800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784935599.880332:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4443393800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784935599.880339:0:37:0:(genops.c:906:class_export_put()) final put ffff8d4443396000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784935599.880341:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4443396000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784935599.880346:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784935599.880435:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457e89c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784935599.880440:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457e899800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784935599.880682:0:15209:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784935599.880687:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784935599.880689:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1784935599.880692:0:15209:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784935599.880694:0:15209:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784935599.880728:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935599.880734:0:15209:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784935599.880740:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d457e89e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784935599.880744:0:37:0:(genops.c:906:class_export_put()) final put ffff8d44419c6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784935599.880746:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44419c6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000004:01000000:2.0:1784935599.880749:0:15209:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:01000000:0.0:1784935599.880753:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784935599.880754:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1626e 00000020:00000080:2.0:1784935599.880758:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d457d24c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784935599.880768:0:15209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1784935599.880771:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935599.880775:0:15209:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784935599.880777:0:15209:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8d4566f3b380) has no exports 00000020:00000080:2.0:1784935599.880781:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16267 00000020:00000080:2.0:1784935599.880784:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d457d0fb000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784935599.880785:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d24c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784935599.880795:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d0fb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784935599.896910:0:15209:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1784935599.896921:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784935599.896946:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1784935599.896955:0:15209:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784935599.897086:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935599.897100:0:15209:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784935599.897146:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935599.897150:0:15209:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784935599.897155:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d4566e96800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784935599.897159:0:15209:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4566e96800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784935599.897176:0:15209:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784935599.897221:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d457d0fa000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784935599.897230:0:8:0:(genops.c:906:class_export_put()) final put ffff8d457d0f8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784935599.897233:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d0f8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1784935599.897244:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784935599.897282:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b160d1 00000020:00000080:2.0:1784935599.897290:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d45705cb800/lustre-MDD0000_UUID 00000020:01000000:2.0:1784935599.897422:0:15209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784935599.897429:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935599.897435:0:15209:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784935599.897439:0:15209:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8d4572a3cd40) has no exports 00000020:00000080:2.0:1784935599.897465:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935599.897469:0:15209:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784935599.897474:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b160d8 00000020:00000080:2.0:1784935599.897479:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d45705cb000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784935599.897684:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d45705cb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1784935599.897689:0:8:0:(genops.c:906:class_export_put()) final put ffff8d45705ca000/lustre-MDD0000_UUID 00000020:00000080:1.0:1784935599.897691:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d45705ca000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784935599.897702:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1784935599.898250:0:15209:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4570329000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784935599.898256:0:15209:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4570329000 3 00000020:01000004:2.0:1784935599.898259:0:15209:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d4570329000 from lustre-MDT0000 00000020:00000080:2.0:1784935599.898281:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935599.898285:0:15209:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784935599.898289:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d45705ce000/lustre-MDT0000_UUID 00000020:00000080:2.0:1784935599.898291:0:15209:0:(genops.c:865:class_export_destroy()) destroying export ffff8d45705ce000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784935599.898360:0:15209:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784935599.898400:0:15209:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1784935599.898404:0:15209:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784935599.898408:0:15209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784935599.898411:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935599.898413:0:15209:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784935599.898419:0:15209:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8d45492d4800 6dcb3e6c-7883-4388-9dd1-46646343e0f5 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784935599.898425:0:15209:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8d4570333380) has exports, disconnecting them 00000020:00080000:2.0:1784935599.898429:0:15209:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d45492d4800), last request at 1784935360 00000020:00000080:2.0:1784935599.898442:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16076 00000020:00010000:2.0:1784935599.898452:0:15209:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d45492d4800: total 1 00000100:00080000:2.0:1784935599.898456:0:15209:0:(import.c:65:import_set_state_nolock()) ffff8d45492d1000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784935599.898514:0:15209:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d45492d4800): rc 0 00000020:00080000:2.0:1784935599.898518:0:15209:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8d4570333380) has no exports 00000100:00100000:2.0:1784935599.898574:0:6517:0:(service.c:3182:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d4572ad5800:6517] 0 exiting: rc = 1 00000020:00010000:1.0:1784935599.898807:0:6514:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d45492d4800: total 1 00010000:00010000:1.0:1784935599.898839:0:6514:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d45492d4800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1784935599.898867:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4442a6ca00/0x857e02f4e0b16825 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b1681e expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.898885:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540030a00/0x857e02f4e0b165b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b165af expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.898898:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d301000/0x857e02f4e0b16497 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b16490 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.898915:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166a800/0x857e02f4e0b165c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b165bd expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.899004:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d454166b200/0x857e02f4e0b16172 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b1616b expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.899020:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d301800/0x857e02f4e0b165e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b165d9 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.899033:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540030400/0x857e02f4e0b165ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b165e7 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.899044:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4442a6da00/0x857e02f4e0b16817 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b16810 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.899057:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b1663b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b16634 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.899071:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d300600/0x857e02f4e0b1658c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b16585 expref: 5 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.899092:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540031400/0x857e02f4e0b16180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b16179 expref: 4 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.899103:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4540031000/0x857e02f4e0b16809 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b16802 expref: 3 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.899114:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4541529800/0x857e02f4e0b1659a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x857e02f4e0b16593 expref: 2 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935599.899124:0:6514:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d45492d4800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1784935599.899137:0:6514:0:(genops.c:906:class_export_put()) final put ffff8d45492d4800/6dcb3e6c-7883-4388-9dd1-46646343e0f5 00000020:00000080:0.0:1784935599.899174:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d45705cb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1784935599.899237:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935599.899240:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935599.899242:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935599.899279:0:6520:0:(service.c:3182:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d4572ad4400:6520] 2 exiting: rc = 0 00000100:00100000:1.0:1784935599.899362:0:6518:0:(service.c:3182:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d4572ad4800:6518] 1 exiting: rc = 0 00000100:00100000:2.0:1784935599.899523:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899532:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899539:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899545:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899551:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899557:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899563:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899568:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899574:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899580:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899585:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899591:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899597:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899602:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899608:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899614:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899620:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899627:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899633:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899639:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899645:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899651:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899656:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899662:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899732:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.899740:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900576:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900589:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900595:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900613:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900620:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900626:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900633:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900639:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900645:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900654:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900659:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900665:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900743:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900749:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900754:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900758:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900764:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900769:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900774:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900779:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900784:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900789:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900793:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900798:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900803:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900808:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900812:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900816:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900821:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900826:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900830:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900835:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900839:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900844:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900850:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900856:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900861:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935599.900865:0:15209:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784935599.902201:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d45492d4800/6dcb3e6c-7883-4388-9dd1-46646343e0f5 for MGS 00000020:00000080:1.0:1784935599.902799:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d45492d1000 for MGS 00000020:01000000:2.0:1784935599.902862:0:15209:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d4441b41cc0 - data ffff8d455e585798/ffff8d457d2ee000 00000020:01000000:2.0:1784935599.903012:0:15209:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d4547f5c060 - data ffff8d455e47e1b0/ffff8d4566ec1800 00000020:00000080:2.0:1784935599.903849:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1605a 00000020:00000080:2.0:1784935599.903858:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d4566fb8000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784935599.903920:0:15209:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4570329000 from MGS, refs=2 00000020:01000004:2.0:1784935599.903942:0:15209:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4570329000 2 00000020:01000004:2.0:1784935599.903946:0:15209:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d4570329000 from MGS 00000020:00000080:2.0:1784935599.903967:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935599.903973:0:15209:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784935599.903976:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d4566fbc800/MGS 00000020:00000080:2.0:1784935599.903978:0:15209:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4566fbc800/MGS for MGS 00000020:01000000:2.0:1784935599.903983:0:15209:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784935599.904051:0:15209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784935599.904054:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935599.904059:0:15209:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784935599.904066:0:15209:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d4570df2800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784935599.904072:0:15209:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8d4570330000) has exports, disconnecting them 00000020:00080000:2.0:1784935599.904076:0:15209:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d4570df2800), last request at 1784935361 00000020:00000080:2.0:1784935599.904080:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16125 00000020:00080000:2.0:1784935599.904090:0:15209:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d4570df2800): rc 0 00000020:00000080:2.0:1784935599.904094:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d4570df2800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784935599.904800:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4566fb8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784935599.906012:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4570df2800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1784935599.946374:0:15209:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1784935599.946383:0:15209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784935599.946387:0:15209:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784935599.946393:0:15209:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784935599.946552:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935599.946562:0:15209:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1784935599.946569:0:15209:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4570329000 1 00000020:00000080:2.0:1784935599.946575:0:15209:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1604c 00000020:00000080:2.0:1784935599.946583:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d4566fbd800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1784935599.946588:0:15209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1784935599.946607:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935599.946611:0:15209:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784935599.946614:0:15209:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8d4570334d40) has no exports 00000020:00000080:0.0:1784935599.946703:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4570df7800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784935599.946710:0:37:0:(genops.c:906:class_export_put()) final put ffff8d4581cd0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784935599.946713:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4581cd0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784935599.946721:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784935599.946919:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4566fbd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784935599.992833:0:15209:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935599.992844:0:15209:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1784935599.992848:0:15209:0:(genops.c:906:class_export_put()) final put ffff8d457032c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784935599.992853:0:15209:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457032c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784935599.992858:0:15209:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1784935599.993051:0:15209:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d457032e000 00000020:02000400:2.0:1784935599.993231:0:15209:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:1.0:1784935600.047473:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784935600.047481:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784935600.047484:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d4573e1e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935600.047493:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 414 00000100:00080000:1.0:1784935600.047499:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784935600.047507:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d4573e1e000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935600.047532:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443d30a80 x1871640292124544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784935600.047549:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784935600.047553:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1784935600.047825:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935600.047845:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292124416:0@lo:400:kworker.0 00000400:00000100:2.0:1784935600.047895:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871640292124416 offset 0 length 224: 4 00000100:00100000:2.0:1784935600.047963:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292124544:0@lo:38:kworker.0 00000100:00100000:2.0:1784935600.048038:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784935600.048171:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d4573f8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935600.048175:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 414 00000100:00080000:1.0:1784935600.048179:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784935600.048183:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d4573f8c800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935600.048200:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443d32a00 x1871640292124672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784935600.048244:0:10724:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292124544 00000100:00100000:2.0:1784935600.048252:0:10724:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292124544 00000100:00100000:2.0:1784935600.048283:0:10724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1784935600.048290:0:10724:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1871640292124544:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784935600.048308:0:10724:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784935600.048427:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292124800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935600.048456:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935600.048486:0:13417:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292124800 00000100:00100000:0.0:1784935600.048490:0:13417:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292124800 00000100:00100000:0.0:1784935600.048528:0:13417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784935600.048535:0:13417:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292124800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935600.048571:0:13417:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784935600.048608:0:13417:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292124800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935600.048615:0:13417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1784935600.048634:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935600.048683:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292124800:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784935600.048742:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784935600.048746:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784935600.048749:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d457d24c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935600.048752:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 414 00000100:00080000:1.0:1784935600.048755:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784935600.048760:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d457d24c800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935600.048777:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443dae680 x1871640292124928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784935600.048807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784935600.048810:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784935600.048812:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d44430bd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935600.048816:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 414 00000100:00080000:1.0:1784935600.048818:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784935600.048822:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d44430bd800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935600.048833:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443dadc00 x1871640292125312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935600.050329:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871640292124672:0@lo:38:kworker.0 00000100:00100000:0.0:1784935600.050423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935600.050454:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1871640292124928:0@lo:38:kworker.0 00000100:00100000:0.0:1784935600.050485:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935600.050501:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1871640292125312:0@lo:38:kworker.0 00000100:00100000:0.0:1784935600.050522:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935600.050612:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292125440:0@lo:400:kworker.0 00000100:00100000:3.0:1784935600.050641:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935600.050681:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784935600.050688:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292125184:0@lo:400:kworker.0 00000100:00100000:3.0:1784935600.050712:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935600.050745:0:8987:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292125184 00000100:00100000:3.0:1784935600.050753:0:8987:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292125184 00000100:00100000:3.0:1784935600.050804:0:8987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784935600.050812:0:8987:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292125184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935600.050868:0:8987:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292125184:12345-0@lo:400:kworker.0 Request processed in 57us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935600.050882:0:8987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784935600.050924:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292125184:0@lo:400:kworker.0 00000100:00100000:2.0:1784935600.054818:0:10724:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1871640292124544:12345-0@lo:38:kworker.0 Request processed in 6517us (6771us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784935600.054831:0:10724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1784935600.056178:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292124672 00000100:00100000:1.0:1784935600.056190:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292124672 00000100:00100000:1.0:1784935600.056267:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292124928 00000100:00100000:1.0:1784935600.056279:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292124928 00000100:00080000:0.0:1784935600.056824:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4573e1e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784935600.056833:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784935600.056838:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292124544:0@lo:38:kworker.0 00000100:00100000:3.0:1784935600.056899:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292125312 00000100:00100000:3.0:1784935600.056904:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292125312 00000100:00100000:3.0:1784935600.056923:0:12375:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292125440 00000100:00100000:3.0:1784935600.056965:0:12375:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292125440 00000100:00100000:3.0:1784935600.057007:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1784935600.057016:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292125440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935600.057110:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292125440:12345-0@lo:400:kworker.0 Request processed in 96us (6468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935600.057118:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1784935600.057135:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784935600.057139:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1871640292124672:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784935600.057159:0:12375:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784935600.057194:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1871640292124672:12345-0@lo:38:kworker.0 Request processed in 53us (6771us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784935600.057200:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784935600.057213:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1784935600.057217:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1871640292124928:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784935600.057226:0:12375:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784935600.057253:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1871640292124928:12345-0@lo:38:kworker.0 Request processed in 34us (6767us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784935600.057259:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1784935600.057271:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1784935600.057275:0:12375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1871640292125312:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784935600.057293:0:12375:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784935600.057320:0:12375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1871640292125312:12345-0@lo:38:kworker.0 Request processed in 43us (6798us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784935600.057327:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:3.0:1784935600.057359:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443daed80 x1871640292125440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935600.057370:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292125440:0@lo:400:kworker.0 00000100:00100000:1.0:1784935600.058270:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935600.058290:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292125056:0@lo:400:kworker.0 00000100:00100000:1.0:1784935600.058339:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935600.058756:0:7797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292125056 00000100:00100000:2.0:1784935600.058775:0:7797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292125056 00000100:00100000:2.0:1784935600.058823:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1784935600.058832:0:7797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292125056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935600.058884:0:7797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292125056:12345-0@lo:400:kworker.0 Request processed in 54us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935600.058900:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00080000:1.0:1784935600.059336:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443dac700 x1871640292125056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935600.059349:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292125056:0@lo:400:kworker.0 00000100:00080000:0.0:1784935600.059445:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935600.059450:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784935600.059474:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4573f8c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784935600.059479:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784935600.059483:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871640292124672:0@lo:38:kworker.0 00000100:00080000:0.0:1784935600.059493:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d457d24c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784935600.059496:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784935600.059498:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1871640292124928:0@lo:38:kworker.0 00000100:00080000:0.0:1784935600.059507:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44430bd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784935600.059510:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784935600.059513:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1871640292125312:0@lo:38:kworker.0 00000040:00080000:2.0:1784935600.113508:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784935600.240291:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935600.559168:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935600.559308:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292125568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935600.559378:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935600.559736:0:8442:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292125568 00000100:00100000:0.0:1784935600.559744:0:8442:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292125568 00000100:00100000:0.0:1784935600.559798:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784935600.559808:0:8442:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292125568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784935600.559838:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1784935600.560309:0:8442:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292125568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 501us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935600.560318:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784935600.560383:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292125568:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784935601.262171:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935602.286782:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784935602.980327:0:15410:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784935602.990866:0:15410:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1784935602.990906:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.990920:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.991002:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.991012:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.991032:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784935602.991037:0:15410:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784935602.991065:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784935602.991070:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784935602.991075:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784935602.991147:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8d4573f8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1784935602.991165:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784935602.991224:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784935602.991228:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784935602.991506:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784935602.991515:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935602.991525:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166a600 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935602.991530:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935602.991611:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935602.991619:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935602.991636:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784935602.991639:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784935602.991642:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784935602.991676:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935602.991683:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935602.991714:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935602.991723:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166a600/0x857e02f4e0b165d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b165e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935602.991735:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935602.991738:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935602.991739:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935602.991831:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292125696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935602.991902:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935602.991982:0:6511:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292125696 00000100:00100000:1.0:1784935602.991989:0:6511:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292125696 00000100:00100000:1.0:1784935602.992078:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784935602.992086:0:6511:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566e68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3652:x1871640292125696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1784935602.992092:0:6511:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784935602 with bad export cookie 9619129104874954870 00010000:00010000:3.0:1784935602.992443:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.992454:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.992462:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.992469:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.992488:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935602.992499:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935602.992503:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.992509:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030600 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:3.0:1784935602.992512:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.992520:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935602.992526:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935602.992530:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784935602.992538:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1784935602.992558:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.992563:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935602.992577:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.992584:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4540030600/0x857e02f4e0b165e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b165ee expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.992598:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935602.992601:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935602.992604:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935602.992611:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784935602.992623:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292125824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784935602.992663:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784935602.995233:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995251:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995260:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995267:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995292:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935602.995299:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995319:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995326:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995343:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995358:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784935602.995368:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784935602.995373:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995380:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300c00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:3.0:1784935602.995383:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995391:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935602.995398:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935602.995403:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784935602.995405:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784935602.995408:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784935602.995441:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995458:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935602.995477:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995484:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d300c00/0x857e02f4e0b16490 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16497 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995501:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935602.995505:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995511:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:3.0:1784935602.995514:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995520:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935602.995527:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935602.995543:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784935602.995546:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784935602.995547:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784935602.995559:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995565:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935602.995578:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995594:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4443699800/0x857e02f4e0b1681e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16825 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995603:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935602.995604:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935602.995606:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935602.995622:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292125952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784935602.995670:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784935602.995700:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b16179 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995707:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b16179 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995714:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b16179 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995720:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b16179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995730:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784935602.995733:0:15410:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1784935602.995736:0:15410:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1784935602.995763:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935602.995767:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b16179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995773:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:3.0:1784935602.995781:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b16179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995788:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b16179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935602.995795:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b16179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935602.995800:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784935602.995801:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784935602.995803:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784935602.995814:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b16179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995818:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935602.995824:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b16179 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995830:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b16179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x857e02f4e0b16180 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935602.995840:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935602.995842:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935602.995844:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784935602.995857:0:15410:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1784935602.995861:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1784935602.995865:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784935602.995870:0:15410:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1784935602.995875:0:15410:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8d4443396800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784935602.995881:0:15410:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8d44419c2000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784935602.995894:0:15410:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff8d457b97b380) has exports, disconnecting them 00000020:00080000:3.0:1784935602.995898:0:15410:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d4443396800), last request at 1784935600 00000020:00000080:3.0:1784935602.995905:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16458 00000100:00080000:3.0:1784935602.995919:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8d4443393000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784935602.995980:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784935602.996010:0:15410:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d4443396800): rc 0 00000020:00000080:3.0:1784935602.996012:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d4443396800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1784935602.996022:0:15410:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d44419c2000), last request at 1784935600 00000020:00000080:3.0:1784935602.996025:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16332 00000100:00080000:3.0:1784935602.996030:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8d44419c5800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1784935602.996041:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4443396800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1784935602.996085:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4443393000 for lustre-MDT0001 00010000:00010000:3.0:1784935602.996093:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784935602.996099:0:15410:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d44419c2000): rc 0 00000020:00000080:3.0:1784935602.996101:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d44419c2000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1784935602.996110:0:15410:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffadd441547ae0 00000020:00000080:3.0:1784935602.996119:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44419c2000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1784935602.996136:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d44419c5800 for lustre-MDT0001 00000100:00080000:3.0:1784935602.996152:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784935602.996156:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1784935602.997013:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784935602.997019:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8d4573e1e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:3.0:1784935602.997064:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292126208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784935602.997109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935602.997132:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784935602.997137:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292126080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784935602.997153:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935602.997191:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292125824 00000100:00100000:0.0:1784935602.997200:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292125824 00000100:00100000:3.0:1784935602.997202:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292125952 00000100:00100000:3.0:1784935602.997208:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292125952 00000100:00100000:0.0:1784935602.997235:0:6512:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292126208 00000100:00100000:3.0:1784935602.997236:0:9527:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292126080 00000100:00100000:3.0:1784935602.997239:0:9527:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292126080 00000100:00100000:0.0:1784935602.997247:0:6512:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292126208 00000100:00100000:3.0:1784935602.997253:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784935602.997261:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1871640292125824:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784935602.997268:0:9527:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784935602 with bad export cookie 9619129104874954870 00000100:00100000:3.0:1784935602.997314:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1871640292125824:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (4652us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784935602.997322:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784935602.997339:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784935602.997343:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1871640292125952:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784935602.997348:0:9527:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784935602 with bad export cookie 9619129104874954870 00010000:00010000:0.0:1784935602.997354:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935602.997374:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1871640292125952:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (1703us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784935602.997380:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784935602.997393:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784935602.997397:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1871640292126080:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784935602.997402:0:9527:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784935602 with bad export cookie 9619129104874954870 00000100:00100000:3.0:1784935602.997426:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1871640292126080:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (272us total) trans 0 rc -107/-107 00000100:00080000:0.0:1784935602.997432:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.128@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1784935602.997433:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1784935602.997440:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8d455e1d4800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784935602.997446:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.128@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1784935602.997448:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784935602.997455:0:9527:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1871640292126208:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784935602.997461:0:9527:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784935602 with bad export cookie 9619129104874954870 00000100:00100000:3.0:1784935602.997485:0:9527:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1871640292126208:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (376us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784935602.997498:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1784935602.997520:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.128@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784935602.998027:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784935602.998031:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1784935602.998042:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784935602.998129:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784935602.998147:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8d44419c3000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784935602.998161:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784935602.998163:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1784935602.998170:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784935602.998225:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784935602.998233:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8d44430bb800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1784935602.998255:0:15410:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8d457b97b380) has no exports 00000100:00100000:2.0:1784935602.999014:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292126336:0@lo:9:umount.0 00000100:00100000:2.0:1784935602.999090:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935602.999115:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292126464:0@lo:9:umount.0 00000100:00100000:2.0:1784935602.999134:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935603.000020:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292126336 00000100:00100000:2.0:1784935603.000029:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292126336 00000100:00100000:2.0:1784935603.000081:0:8440:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292126464 00000100:00100000:2.0:1784935603.000084:0:8440:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292126464 00000100:00100000:2.0:1784935603.000107:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784935603.000115:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871640292126336:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784935603.000156:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1637f 00000100:00080000:2.0:1784935603.000165:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8d45757d8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784935603.000203:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1784935603.000358:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3648:x1871640292126336:12345-0@lo:9:umount.0 Request processed in 243us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935603.000366:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784935603.000380:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784935603.000387:0:8440:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871640292126464:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784935603.000399:0:8440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b164c1 00000100:00080000:2.0:1784935603.000403:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8d457b989800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784935603.000422:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1784935603.000509:0:8440:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3648:x1871640292126464:12345-0@lo:9:umount.0 Request processed in 122us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935603.000515:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1784935603.000554:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44419c3000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784935603.000560:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784935603.000562:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784935603.000565:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292126336:0@lo:9:umount.0 00000100:00080000:2.0:1784935603.000575:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44430bb800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784935603.000582:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784935603.000583:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784935603.000585:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292126464:0@lo:9:umount.0 00000100:00080000:0.0:1784935603.004279:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.128@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784935603.004284:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784935603.004294:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443d33800 x1871640292124416/t0(0) o400->MGC192.168.203.128@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784935616 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935603.004496:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443dac000 x1871640292125696/t0(0) o103->MGC192.168.203.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784935618 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935603.004507:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4574004380 x1871640292125824/t0(0) o103->MGC192.168.203.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784935618 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935603.004516:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4574032300 x1871640292125952/t0(0) o103->MGC192.168.203.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784935618 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935603.004523:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4574032d80 x1871640292126208/t0(0) o103->MGC192.168.203.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784935618 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935603.004531:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4574030e00 x1871640292126080/t0(0) o103->MGC192.168.203.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784935618 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784935603.004551:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784935603.004554:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784935603.004556:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784935603.004559:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8d455e1d4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784935603.004565:0:3650:0:(import.c:510:import_select_connection()) MGC192.168.203.128@tcp: connect to NID 0@lo last attempt 179 00000100:00080000:0.0:1784935603.004576:0:3650:0:(import.c:624:import_select_connection()) MGC192.168.203.128@tcp: import ffff8d455e1d4800 using connection 192.168.203.128@tcp/0@lo 00000100:00080000:3.0:1784935603.004582:0:3652:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d455e1d4800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1784935603.004612:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292126208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784935603.004624:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292125696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784935603.004657:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3652:1871640292126080:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1784935603.004665:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784935603.004671:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784935603.004698:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935603.004698:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935603.004733:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443432300 x1871640292126592/t0(0) o250->MGC192.168.203.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935603.004778:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292125824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935603.004798:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3650:1871640292125952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784935603.004870:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3648:1871640292126592:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1784935603.004916:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871640292126592 offset 0 length 520: 4 00000100:00100000:2.0:1784935603.005132:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3649:1871640292124416:0@lo:400:kworker.0 00000400:00000100:1.0:1784935603.015922:0:6511:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1871640292125696 offset 224 length 224: 4 00000100:00100000:1.0:1784935603.016201:0:6511:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566e68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3652:x1871640292125696:12345-0@lo:103:ldlm_bl.0 Request processed in 24111us (24296us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784935603.016212:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00080000:1.0:1784935603.025197:0:15410:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8d457b97b380) has no exports 00000020:01000000:0.0:1784935603.060094:0:15410:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d444333d480 - data ffff8d455e735948/ffff8d44434afc00 00000020:01000000:0.0:1784935603.060234:0:15410:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d457d087420 - data ffff8d455e587e58/ffff8d457d063000 00000001:00000004:3.0:1784935603.080110:0:15410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1784935603.114463:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784935603.114473:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1784935603.114481:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784935603.119040:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784935603.119048:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1784935603.119060:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784935603.119062:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784935603.119317:0:8980:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784935603.119322:0:8980:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1784935603.119332:0:8980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1784935603.120619:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784935603.120625:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1784935603.120647:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784935603.120649:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784935603.124404:0:9952:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784935603.124414:0:9952:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1784935603.124427:0:9952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1784935603.135250:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1619c 00000020:00000080:1.0:1784935603.135261:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d4542ba9000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784935603.135289:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4542ba9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784935603.138190:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b161b1 00000020:00000080:1.0:1784935603.138202:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d457b988000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1784935603.138222:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1784935603.138227:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784935603.138235:0:15410:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784935603.138239:0:15410:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8d457b97cd40) has no exports 00000020:00000080:0.0:1784935603.138368:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457b988000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:1.0:1784935603.138438:0:15410:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784935603.138447:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b164ba 00000020:00000080:1.0:1784935603.138453:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d44428f2800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1784935603.138470:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1784935603.138474:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784935603.138481:0:15410:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784935603.138484:0:15410:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff8d444209cd40) has no exports 00000020:00000080:1.0:1784935603.138490:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b164b3 00000020:00000080:1.0:1784935603.138494:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d44430b9000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784935603.138741:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44428f2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1784935603.138760:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44430b9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1784935603.138882:0:15410:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1784935603.138887:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784935603.138891:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1784935603.138897:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784935603.138900:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784935603.140143:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d44430bb800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1784935603.140151:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784935603.140164:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784935603.140168:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d44428f5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784935603.140171:0:15410:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44428f5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1784935603.140177:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784935603.140256:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16378 00000020:00000080:1.0:1784935603.140261:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d457d0fa800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1784935603.140277:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1784935603.140281:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784935603.140285:0:15410:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784935603.140298:0:15410:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff8d4581c94d40) has no exports 00000020:00000080:0.0:1784935603.140301:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d0fa800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1784935603.140304:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16371 00000020:00000080:1.0:1784935603.140311:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d44419c1000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784935603.140559:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44419c1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1784935603.140878:0:15410:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1784935603.140884:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784935603.140888:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1784935603.140894:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784935603.140897:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784935603.140923:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784935603.140989:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d44419c3000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1784935603.141095:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784935603.141100:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d44419c1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784935603.141102:0:15410:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44419c1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1784935603.141108:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1784935603.141185:0:15410:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1784935603.141193:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b161d4 00000020:00000080:1.0:1784935603.141199:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d457b960000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1784935603.141214:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1784935603.141218:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784935603.141223:0:15410:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784935603.141226:0:15410:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8d4566f3cd40) has no exports 00000020:00000080:1.0:1784935603.141231:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b161cd 00000020:00000080:1.0:1784935603.141235:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d4573e19800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784935603.141293:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457b960000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1784935603.141305:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4573e19800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1784935603.144041:0:15410:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1784935603.144050:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784935603.144055:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1784935603.144063:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784935603.144121:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4573e1e000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1784935603.144127:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784935603.144138:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784935603.144143:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d4573e18000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784935603.144147:0:15410:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4573e18000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1784935603.144155:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784935603.144317:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784935603.144325:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784935603.144328:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d4581e8c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784935603.144330:0:15410:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4581e8c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1784935603.144340:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784935603.144462:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b161b8 00000020:00000080:0.0:1784935603.144472:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d457b98a000/lustre-MDD0001_UUID 00000020:01000000:0.0:1784935603.144485:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1784935603.144489:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784935603.144494:0:15410:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784935603.144497:0:15410:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff8d457b978000) has no exports 00000020:00000080:3.0:1784935603.144502:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457b98a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1784935603.144533:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784935603.144542:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1784935603.144545:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d4581e8e000/lustre-MDD0001_UUID 00000020:00000080:0.0:1784935603.144547:0:15410:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4581e8e000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1784935603.144556:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1784935603.144742:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b161bf 00000020:00000080:0.0:1784935603.144747:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d457b98f800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1784935603.144764:0:15410:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4570c47800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1784935603.144768:0:15410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4570c47800 2 00000020:01000004:0.0:1784935603.144775:0:15410:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d4570c47800 from lustre-MDT0001 00000020:00000080:0.0:1784935603.144802:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784935603.144806:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1784935603.144809:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d4542bab000/lustre-MDT0001_UUID 00000020:00000080:0.0:1784935603.144811:0:15410:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4542bab000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1784935603.144818:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:3.0:1784935603.144822:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457b98f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:0.0:1784935603.144849:0:15410:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1784935603.144854:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1784935603.144856:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784935603.144859:0:15410:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784935603.144866:0:15410:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8d4573f8b000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784935603.144870:0:15410:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff8d45703319c0) has exports, disconnecting them 00000020:00080000:0.0:1784935603.144875:0:15410:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8d4573f8b000), last request at 1784935378 00000020:00000080:0.0:1784935603.144878:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16213 00000020:00080000:0.0:1784935603.144892:0:15410:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d4573f8b000): rc 0 00000020:00000080:0.0:1784935603.144895:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d4573f8b000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1784935603.144984:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4573f8b000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1784935603.151024:0:15410:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1784935603.151033:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784935603.151037:0:15410:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784935603.151044:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784935603.151183:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784935603.151192:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1784935603.151199:0:15410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4570c47800 1 00000020:00000080:0.0:1784935603.151205:0:15410:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1614f 00000020:00000080:0.0:1784935603.151214:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d4581cd2000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1784935603.151220:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1784935603.151224:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784935603.151228:0:15410:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784935603.151231:0:15410:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8d4581c90000) has no exports 00000020:00000080:3.0:1784935603.165039:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d4573f8c800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1784935603.165053:0:37:0:(genops.c:906:class_export_put()) final put ffff8d4581c8d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1784935603.165056:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4581c8d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1784935603.165064:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1784935603.165463:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4581cd2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784935603.182598:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784935603.182668:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1784935603.182678:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d4570c42000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784935603.182691:0:15410:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4570c42000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1784935603.182702:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1784935603.182823:0:15410:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d4570c42800 00000020:01000000:0.0:1784935603.182844:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1784935603.182849:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784935603.182854:0:15410:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784935603.182857:0:15410:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8d4566f399c0) has no exports 00000100:00100000:1.0:1784935603.183841:0:7797:0:(service.c:3182:ptlrpc_main()) mdt00_003: service thread [ffff8d457b8f7e00:7797] 3 exiting: rc = 0 00000100:00100000:3.0:1784935603.183858:0:6525:0:(service.c:3182:ptlrpc_main()) mdt00_000: service thread [ffff8d455e328600:6525] 0 exiting: rc = 1 00000100:00100000:0.0:1784935603.183961:0:6527:0:(service.c:3182:ptlrpc_main()) mdt00_002: service thread [ffff8d456dd13600:6527] 2 exiting: rc = 0 00000100:00100000:3.0:1784935603.185669:0:12375:0:(service.c:3182:ptlrpc_main()) mdt00_004: service thread [ffff8d44435dbc00:12375] 4 exiting: rc = 0 00000100:00100000:0.0:1784935603.185695:0:6526:0:(service.c:3182:ptlrpc_main()) mdt00_001: service thread [ffff8d456dd12c00:6526] 1 exiting: rc = 0 00000100:00100000:1.0:1784935603.185747:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185756:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185762:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185767:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185773:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185778:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185785:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185791:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185797:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185811:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185817:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185822:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185827:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185833:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185838:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185843:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185848:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185852:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185857:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185863:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185870:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185875:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185881:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185887:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185892:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185898:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185903:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185908:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185913:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185917:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185922:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185942:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185949:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185957:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185962:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185983:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185990:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.185995:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186002:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186008:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186013:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186018:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186023:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186029:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186042:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186048:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186053:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186060:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186065:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186081:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186092:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186099:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186105:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186110:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186116:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186130:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186135:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186140:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186146:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186151:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186157:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186163:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186176:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.186183:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784935603.188658:0:6528:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d456dd13a00:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1784935603.193281:0:6529:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d454928d000:6529] 1 exiting: rc = 0 00000100:00100000:1.0:1784935603.193404:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193414:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193422:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193428:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193436:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193444:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193451:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193459:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193466:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193473:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193481:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193489:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193497:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193504:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193510:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193532:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193538:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193544:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193551:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193558:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193566:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193573:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193581:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193586:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193592:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193599:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193605:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193613:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193620:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193627:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193637:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193646:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193657:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193665:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193670:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193675:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193681:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193685:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193690:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193696:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193700:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193706:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193719:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193724:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193729:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193734:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193738:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193744:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193749:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193753:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193766:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193770:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193775:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193779:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193784:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193788:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193792:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193797:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193802:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193806:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193811:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193817:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193823:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.193830:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.195664:0:10724:0:(service.c:3182:ptlrpc_main()) mdt_out00_002: service thread [ffff8d4573405400:10724] 2 exiting: rc = 0 00000100:00100000:2.0:1784935603.196160:0:6531:0:(service.c:3182:ptlrpc_main()) mdt_out00_001: service thread [ffff8d4549f33600:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1784935603.196522:0:6530:0:(service.c:3182:ptlrpc_main()) mdt_out00_000: service thread [ffff8d4572ae0a00:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1784935603.196709:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196719:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196728:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196734:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196740:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196758:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196780:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196787:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196868:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196878:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196886:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196893:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196902:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196910:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196918:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196949:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196959:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.196973:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.199847:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.199865:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.199871:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.199896:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.199903:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.199910:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.199919:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.199943:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.199953:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.199964:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200154:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200169:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200193:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200200:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200206:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200211:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200217:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200223:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200230:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200235:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200242:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200247:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200253:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200259:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200279:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200287:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200292:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200298:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200305:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200311:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200316:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200322:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200328:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200334:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200340:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200347:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200366:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200373:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200384:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200389:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200690:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200702:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200708:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200714:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200720:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935603.200727:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784935603.214886:0:6532:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d4566ecd600:6532] 0 exiting: rc = 1 00000100:00100000:1.0:1784935603.214894:0:6533:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d4572ae0600:6533] 1 exiting: rc = 0 00000100:00100000:0.0:1784935603.215517:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215525:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215530:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215536:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215541:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215546:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215551:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215556:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215561:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215567:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215573:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215577:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215583:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215589:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215595:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215601:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215606:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215611:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215617:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215622:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215628:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215632:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215638:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215657:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215663:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215668:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215673:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215679:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215683:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215688:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215694:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215699:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215704:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215709:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215715:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215721:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215726:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215732:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215737:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215742:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215747:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215752:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215758:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215764:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215769:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215775:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215781:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215786:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215791:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215796:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215802:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215807:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215813:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215819:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215824:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215830:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215835:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215840:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215855:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215860:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215865:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215871:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215877:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.215882:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.216793:0:6534:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d4572ae0c00:6534] 0 exiting: rc = 1 00000100:00100000:2.0:1784935603.216878:0:6535:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d4561ed3400:6535] 1 exiting: rc = 0 00000100:00100000:0.0:1784935603.216959:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.216978:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.216984:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.216989:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.216995:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217000:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217004:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217009:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217014:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217019:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217024:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217029:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217033:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217038:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217043:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217048:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217054:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217059:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217064:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217069:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217341:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217350:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217355:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217360:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217365:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217370:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217375:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217380:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217386:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217401:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217464:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217472:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217480:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217490:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217495:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217501:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217507:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217512:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217516:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217522:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217528:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217532:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217537:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217581:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217587:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217593:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217601:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217611:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217617:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217622:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217627:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217632:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217638:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217643:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217647:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217652:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217656:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217661:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217666:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217670:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217676:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217681:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217686:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935603.217691:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221532:0:6536:0:(service.c:3182:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d456de35600:6536] 0 exiting: rc = 1 00000100:00100000:2.0:1784935603.221673:0:6537:0:(service.c:3182:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d456de35a00:6537] 1 exiting: rc = 0 00000100:00100000:2.0:1784935603.221728:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221740:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221748:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221756:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221764:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221771:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221780:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221785:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221790:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221794:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221799:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221803:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221808:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221813:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221817:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221822:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221827:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221831:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221836:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221843:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221850:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221857:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221865:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221872:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221879:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221886:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221892:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221897:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221904:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221911:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221918:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221925:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221953:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221958:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.221985:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222070:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222147:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222157:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222167:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222175:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222182:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222189:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222197:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222207:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222215:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222222:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222230:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222237:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222244:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222251:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222258:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222263:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222267:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222271:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222276:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222280:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222285:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222289:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222294:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222298:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222302:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222307:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222312:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222316:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.222803:0:6538:0:(service.c:3182:ptlrpc_main()) mdt_io00_000: service thread [ffff8d4570ca1800:6538] 0 exiting: rc = 1 00000100:00100000:2.0:1784935603.223264:0:6540:0:(service.c:3182:ptlrpc_main()) mdt_io00_002: service thread [ffff8d4566edd200:6540] 2 exiting: rc = 0 00000100:00100000:2.0:1784935603.223668:0:6539:0:(service.c:3182:ptlrpc_main()) mdt_io00_001: service thread [ffff8d4570ca1400:6539] 1 exiting: rc = 0 00000100:00100000:2.0:1784935603.223737:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223746:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223761:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223768:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223775:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223783:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223790:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223795:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223802:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223811:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223816:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223824:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223840:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223848:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223854:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223860:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223866:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223872:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223878:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223885:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223892:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223898:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223905:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223910:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223917:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.223923:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224436:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224445:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224450:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224456:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224462:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224467:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224473:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224478:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224484:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224491:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224520:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224534:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224540:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224546:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224552:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224557:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224562:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224567:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224573:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224578:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224584:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224634:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224640:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224645:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224650:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224656:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224663:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224668:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224674:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224680:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224686:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224692:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224698:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224704:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224709:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224715:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224721:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935603.224728:0:15410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784935603.228087:0:15410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784935603.228100:0:15410:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1784935603.228105:0:15410:0:(genops.c:906:class_export_put()) final put ffff8d4566e94800/MDS_uuid 00000020:00000080:3.0:1784935603.228109:0:15410:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4566e94800/MDS_uuid for MDS 00000020:01000000:3.0:1784935603.228115:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1784935603.228310:0:15410:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1784935603.310051:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935604.333502:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784935605.165040:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784935605.165050:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784935605.165052:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784935605.165057:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784935605.165061:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d457d24c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935605.165069:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1784935605.165074:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784935605.165081:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d457d24c800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935605.165118:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443dace00 x1871640292126720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784935605.165181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784935605.165185:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784935605.165186:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d44430bd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935605.165190:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1784935605.165193:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784935605.165197:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d44430bd800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935605.165209:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443dad500 x1871640292126976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784935605.165269:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1871640292126720:0@lo:38:kworker.0 00000100:00100000:1.0:1784935605.165277:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292127104:0@lo:400:kworker.0 00000100:00100000:2.0:1784935605.165500:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292126848:0@lo:400:kworker.0 00000400:00000100:3.0:1784935605.165659:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871640292126720 offset 0 length 520: 4 00000100:00100000:3.0:1784935605.165708:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1871640292126976:0@lo:38:kworker.0 00000400:00000100:3.0:1784935605.165728:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871640292126976 offset 0 length 520: 4 00000400:00000100:2.0:1784935605.167268:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871640292126848 offset 0 length 224: 4 00000400:00000100:1.0:1784935605.169152:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871640292127104 offset 0 length 224: 4 00010000:00010000:0.0:1784935605.358797:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935606.381228:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784935606.504468:0:15610:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784935606.530125:0:15610:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1784935606.530189:0:15610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935606.530205:0:15610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935606.530214:0:15610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935606.530222:0:15610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935606.530245:0:15610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784935606.530251:0:15610:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1784935606.530479:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935606.530487:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935606.530494:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d454166b400 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935606.530498:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935606.530507:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935606.530514:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935606.530519:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784935606.530522:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784935606.530525:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784935606.530540:0:6514:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d455e1d4800 00010000:00010000:0.0:1784935606.530543:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935606.530549:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d454166b400/0x857e02f4e0b165af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b165b6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935606.530561:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935606.530563:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935606.530564:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784935606.530714:0:15610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784935606.530726:0:15610:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443dace00 x1871640292126720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784935625 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935606.530742:0:15610:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784935606.530747:0:15610:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784935606.530753:0:15610:0:(import.c:65:import_set_state_nolock()) ffff8d457d24c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1784935606.530756:0:15610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784935606.530759:0:15610:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443dace00 x1871640292126720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784935625 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935606.530765:0:15610:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784935606.530782:0:15610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:3.0:1784935606.530883:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1871640292126720:0@lo:38:kworker.0 00000100:00080000:0.0:1784935606.535023:0:15610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784935606.535041:0:15610:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443dadf80 x1871640292126848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935621 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935606.535078:0:15610:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784935606.535086:0:15610:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784935606.535108:0:15610:0:(import.c:65:import_set_state_nolock()) ffff8d44421b0000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784935606.535439:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1871640292127232:0@lo:39:umount.0 00000400:00000100:1.0:1784935606.535487:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871640292127232 offset 0 length 224: 4 00000100:00100000:3.0:1784935606.535568:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292126848:0@lo:400:kworker.0 00010000:00010000:2.0:1784935607.405519:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784935608.175404:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784935608.175413:0:15171:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784935608.175416:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784935608.175419:0:15171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784935608.175561:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292127360:0@lo:400:kworker.0 00000400:00000100:2.0:1784935608.175615:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871640292127360 offset 0 length 224: 4 00010000:00010000:0.0:1784935608.429134:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784935608.752613:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784935608.752622:0:8431:0:(genops.c:906:class_export_put()) final put ffff8d45757df000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784935608.753604:0:15171:0:(genops.c:865:class_export_destroy()) destroying export ffff8d45757df000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784935608.754255:0:15171:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d45757d8000 for lustre-OST0000 00000001:00100000:2.0:1784935608.755836:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784935608.755844:0:9518:0:(genops.c:906:class_export_put()) final put ffff8d457b988800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784935608.757346:0:15171:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457b988800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1784935608.757622:0:15171:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d457b989800 for lustre-OST0001 00010000:00010000:2.0:1784935609.453371:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784935610.222728:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784935610.222740:0:15171:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784935610.222744:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784935610.222747:0:15171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784935610.222888:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292127488:0@lo:400:kworker.0 00000400:00000100:3.0:1784935610.222974:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871640292127488 offset 0 length 224: 4 00010000:00010000:0.0:1784935610.478460:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935611.501188:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935612.525570:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935613.549146:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935613.677393:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935603/real 1784935603] req@ffff8d4443432300 x1871640292126592/t0(0) o250->MGC192.168.203.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784935613 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935613.677428:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4443432300 x1871640292126592/t0(0) o250->MGC192.168.203.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784935613 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784935613.677447:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d455e1d4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784935613.677519:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1784935613.677524:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3648:1871640292126592:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1784935613.677709:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784935613.677788:0:15171:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1784935613.677791:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8d455e1d4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784935613.677796:0:15171:0:(import.c:510:import_select_connection()) MGC192.168.203.128@tcp: connect to NID 0@lo last attempt 422 00000100:00080000:3.0:1784935613.677801:0:15171:0:(import.c:589:import_select_connection()) MGC192.168.203.128@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784935613.677808:0:15171:0:(import.c:624:import_select_connection()) MGC192.168.203.128@tcp: import ffff8d455e1d4800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935613.677841:0:15171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574030e00 x1871640292127616/t0(0) o250->MGC192.168.203.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784935613.677970:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3648:1871640292127616:0@lo:250:kworker.0 00000400:00000100:1.0:1784935613.678018:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871640292127616 offset 0 length 520: 4 00000100:00080000:3.0:1784935613.678841:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784935613.678847:0:15171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784935613.679051:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935613.679064:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292127744:0@lo:400:kworker.0 00000400:00000100:0.0:1784935613.679097:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871640292127744 offset 0 length 224: 4 00010000:00010000:0.0:1784935614.573164:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935615.598166:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935616.621718:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935616.749035:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935606/real 1784935606] req@ffff8d4443433b80 x1871640292127232/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784935616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935616.749066:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4443433b80 x1871640292127232/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784935616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784935616.749097:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44421b0000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784935616.749115:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1871640292127232:0@lo:39:umount.0 00000100:00080000:0.0:1784935616.749296:0:15610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784935616.749301:0:15610:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784935616.749306:0:15610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784935616.750436:0:15610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935616.750452:0:15610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935616.750476:0:15610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935616.750483:0:15610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935616.750619:0:15610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784935616.750628:0:15610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935616.750635:0:15610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935616.750640:0:15610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935616.750646:0:15610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935616.753347:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784935616.753362:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935616.753373:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540031200 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935616.753378:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935616.753388:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935616.753396:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935616.753402:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784935616.753405:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1784935616.753419:0:6513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d455e1d4800 00010000:00010000:2.0:1784935616.753423:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935616.753431:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4540031200/0x857e02f4e0b165bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b165c4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935616.753449:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935616.753470:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935616.753476:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540031800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935616.753479:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935616.753486:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935616.753492:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935616.753497:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784935616.753499:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1784935616.753505:0:6513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d455e1d4800 00010000:00010000:2.0:1784935616.753508:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935616.753516:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935616.753518:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935616.753519:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935616.753733:0:15610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784935616.753741:0:15610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4540031800/0x857e02f4e0b16810 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b16817 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935616.753751:0:15610:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1784935616.753756:0:15610:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1784935616.753758:0:15610:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1784935616.753793:0:15610:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1784935616.753797:0:15610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1784935616.753803:0:15610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784935616.753815:0:15610:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784935616.753819:0:15610:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8d457b9799c0) has no exports 00000020:00080000:0.0:1784935616.753842:0:15610:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8d457b9799c0) has no exports 00000020:01000000:0.0:1784935616.755629:0:15610:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d444333d8a0 - data ffff8d4441c91bd0/ffff8d44434ac800 00010000:00010000:2.0:1784935616.759347:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1784935616.759475:0:15610:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d457d087a20 - data ffff8d455e69ae58/ffff8d44419d7800 00100000:10000000:0.0:1784935616.773678:0:15610:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1784935616.781776:0:15610:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b162ec 00000020:00000080:1.0:1784935616.781791:0:15610:0:(genops.c:906:class_export_put()) final put ffff8d4581c89000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1784935616.781821:0:15610:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d457b962000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1784935616.781825:0:15610:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457b962000 2 00000020:01000004:1.0:1784935616.781829:0:15610:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d457b962000 from lustre-OST0000 00000020:00000080:2.0:1784935616.781860:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4581c89000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784935616.781885:0:15610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784935616.781896:0:15610:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1784935616.781899:0:15610:0:(genops.c:906:class_export_put()) final put ffff8d457b98c800/lustre-OST0000_UUID 00000020:00000080:1.0:1784935616.781902:0:15610:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457b98c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1784935616.781909:0:15610:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1784935616.782739:0:15610:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1784935616.782746:0:15610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1784935616.782750:0:15610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784935616.782756:0:15610:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784935616.782763:0:15610:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d457d0f8000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784935616.782769:0:15610:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff8d444209b380) has exports, disconnecting them 00000020:00080000:1.0:1784935616.782774:0:15610:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d457d0f8000), last request at 1784935395 00000020:00000080:1.0:1784935616.782778:0:15610:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16316 00000020:00080000:1.0:1784935616.782790:0:15610:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d457d0f8000): rc 0 00000020:00000080:1.0:1784935616.782796:0:15610:0:(genops.c:906:class_export_put()) final put ffff8d457d0f8000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1784935616.786643:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d0f8000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1784935616.791134:0:15610:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1784935616.791144:0:15610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784935616.791148:0:15610:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784935616.791155:0:15610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784935616.791705:0:15610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935616.791728:0:15610:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1784935616.791735:0:15610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784935616.791739:0:15610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935616.791744:0:15610:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784935616.791751:0:15610:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d44421b7000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784935616.791758:0:15610:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff8d4442098000) has exports, disconnecting them 00000020:00080000:2.0:1784935616.791762:0:15610:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d44421b7000), last request at 1784935395 00000020:00000080:2.0:1784935616.791767:0:15610:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1632b 00000020:00080000:2.0:1784935616.791782:0:15610:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d44421b7000): rc 0 00000020:00000080:2.0:1784935616.791788:0:15610:0:(genops.c:906:class_export_put()) final put ffff8d44421b7000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1784935616.792071:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d457d24c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1784935616.792078:0:8:0:(genops.c:906:class_export_put()) final put ffff8d457d0fc000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1784935616.792081:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d0fc000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1784935616.792091:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1784935616.792152:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44421b7000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1784935616.794246:0:15610:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1784935616.794253:0:15610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784935616.794257:0:15610:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784935616.794264:0:15610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784935616.794414:0:15610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935616.794422:0:15610:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1784935616.794428:0:15610:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457b962000 1 00000020:00000080:2.0:1784935616.794435:0:15610:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b162b4 00000020:00000080:2.0:1784935616.794442:0:15610:0:(genops.c:906:class_export_put()) final put ffff8d457d24d000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1784935616.794448:0:15610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1784935616.794452:0:15610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935616.794456:0:15610:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784935616.794459:0:15610:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff8d4581c919c0) has no exports 00000020:00000080:2.0:1784935616.798390:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d44421b0000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1784935616.798405:0:8:0:(genops.c:906:class_export_put()) final put ffff8d44421b4000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1784935616.798408:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44421b4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1784935616.798414:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1784935616.798479:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d24d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784935616.855074:0:15610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784935616.855089:0:15610:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1784935616.855094:0:15610:0:(genops.c:906:class_export_put()) final put ffff8d457b967800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1784935616.855099:0:15610:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457b967800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1784935616.855111:0:15610:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1784935616.855388:0:15610:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d457b962800 00000020:02000400:1.0:1784935616.855465:0:15610:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1784935617.645125:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935618.672598:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784935618.989888:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784935618.989898:0:15171:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784935618.989900:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784935618.989904:0:15171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784935618.990159:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935618.990182:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292127872:0@lo:400:kworker.0 00000400:00000100:2.0:1784935618.990240:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871640292127872 offset 0 length 224: 4 00010000:00010000:2.0:1784935619.693130:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784935620.140833:0:15812:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784935620.153080:0:15812:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1784935620.153316:0:15812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935620.153332:0:15812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935620.153340:0:15812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935620.153347:0:15812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935620.153378:0:15812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784935620.153384:0:15812:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784935620.153409:0:15812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784935620.153423:0:15812:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443dad500 x1871640292126976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784935625 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935620.153443:0:15812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784935620.153462:0:15812:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784935620.153468:0:15812:0:(import.c:65:import_set_state_nolock()) ffff8d44430bd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1784935620.153473:0:15812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784935620.153478:0:15812:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443dad500 x1871640292126976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784935625 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935620.153485:0:15812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784935620.153488:0:15812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:0.0:1784935620.154230:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935620.154240:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935620.154250:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528400 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935620.154253:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935620.154263:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935620.154271:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935620.154276:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784935620.154279:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784935620.154281:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784935620.154319:0:6514:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d455e1d4800 00010000:00010000:0.0:1784935620.154323:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935620.154331:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4541528400/0x857e02f4e0b16585 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b1658c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935620.154359:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935620.154361:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935620.154363:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935620.154512:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1871640292126976:0@lo:38:kworker.0 00000100:00080000:2.0:1784935620.157013:0:15812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784935620.157029:0:15812:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443dac380 x1871640292127104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935621 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935620.157045:0:15812:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443433800 x1871640292127360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935624 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935620.157064:0:15812:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443dad880 x1871640292127488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935626 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935620.157076:0:15812:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4574032d80 x1871640292127744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935629 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935620.157085:0:15812:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443cd5c00 x1871640292127872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935634 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935620.157223:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292127744:0@lo:400:kworker.0 00000100:00100000:3.0:1784935620.157287:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292127360:0@lo:400:kworker.0 00000100:00100000:2.0:1784935620.158916:0:15812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784935620.158939:0:15812:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1784935620.159294:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292127872:0@lo:400:kworker.0 00000100:00100000:0.0:1784935620.159471:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292127104:0@lo:400:kworker.0 00000100:00100000:3.0:1784935620.160381:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292127488:0@lo:400:kworker.0 00000100:00080000:2.0:1784935620.160678:0:15812:0:(import.c:65:import_set_state_nolock()) ffff8d44430bf000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784935620.160719:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1871640292128000:0@lo:39:umount.0 00000400:00000100:3.0:1784935620.160760:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871640292128000 offset 0 length 224: 4 00010000:00010000:2.0:1784935620.717252:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935621.741696:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935622.769188:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935623.789372:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784935624.110412:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784935624.110422:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1784935624.813281:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935625.837736:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935626.864176:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935627.885670:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935628.333052:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935613/real 1784935613] req@ffff8d4574030e00 x1871640292127616/t0(0) o250->MGC192.168.203.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784935628 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935628.333087:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4574030e00 x1871640292127616/t0(0) o250->MGC192.168.203.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784935628 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784935628.333109:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d455e1d4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784935628.333190:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1784935628.333195:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3648:1871640292127616:0@lo:250:kworker.0 00000100:00080000:1.0:1784935628.334575:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784935628.334583:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1784935628.334587:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d455e1d4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935628.334593:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.128@tcp: connect to NID 0@lo last attempt 432 00000100:00080000:1.0:1784935628.334598:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.128@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784935628.334606:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.128@tcp: import ffff8d455e1d4800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935628.334640:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443dae300 x1871640292128128/t0(0) o250->MGC192.168.203.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784935628.334790:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3648:1871640292128128:0@lo:250:kworker.0 00000400:00000100:3.0:1784935628.334845:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871640292128128 offset 0 length 520: 4 00010000:00010000:2.0:1784935628.911466:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935629.933240:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935630.381117:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935620/real 1784935620] req@ffff8d4443cd7100 x1871640292128000/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784935630 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935630.381153:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4443cd7100 x1871640292128000/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784935630 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784935630.381172:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44430bf000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784935630.381195:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1871640292128000:0@lo:39:umount.0 00000100:00080000:2.0:1784935630.381293:0:15812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784935630.381298:0:15812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784935630.381318:0:15812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784935630.385515:0:15812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935630.385532:0:15812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935630.385540:0:15812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935630.385547:0:15812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935630.385616:0:15812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784935630.385624:0:15812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935630.385631:0:15812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935630.385638:0:15812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935630.385644:0:15812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935630.386726:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784935630.386744:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935630.386754:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301200 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:3.0:1784935630.386759:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935630.386768:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935630.386775:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935630.386781:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784935630.386784:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1784935630.386809:0:6513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d455e1d4800 00010000:00010000:3.0:1784935630.386813:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935630.386899:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d301200/0x857e02f4e0b16593 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b1659a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935630.386915:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935630.386918:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935630.386925:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698600 already unused, calling callback (ffffffffc12b4c20) 00010000:00010000:2.0:1784935630.387008:0:15812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1784935630.387016:0:15812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1784935630.387021:0:15812:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1784935630.387062:0:15812:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1784935630.387066:0:15812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1784935630.387077:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935630.387083:0:15812:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784935630.387087:0:15812:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8d4581ed8000) has no exports 00000020:00080000:2.0:1784935630.387123:0:15812:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8d4581ed8000) has no exports 10000000:00010000:3.0:1784935630.387363:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935630.387372:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935630.387378:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935630.387383:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784935630.387385:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784935630.387387:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784935630.387395:0:6513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d455e1d4800 00010000:00010000:3.0:1784935630.387398:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935630.387404:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b16802 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b16809 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935630.387419:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935630.387421:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935630.389943:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935630.390429:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1784935630.390916:0:15812:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d44422fd2a0 - data ffff8d455e7376c0/ffff8d457d3ecc00 00000020:01000000:2.0:1784935630.391600:0:15812:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d4441b41180 - data ffff8d455e740e58/ffff8d457d3e8c00 00100000:10000000:2.0:1784935630.400642:0:15812:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784935630.413775:0:15812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16412 00000020:00000080:2.0:1784935630.413795:0:15812:0:(genops.c:906:class_export_put()) final put ffff8d457d1b6800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1784935630.413811:0:15812:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d457d24e000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1784935630.413815:0:15812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457d24e000 2 00000020:01000004:2.0:1784935630.413819:0:15812:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d457d24e000 from lustre-OST0001 00000020:00000080:2.0:1784935630.413855:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935630.413866:0:15812:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1784935630.413869:0:15812:0:(genops.c:906:class_export_put()) final put ffff8d457d1b0800/lustre-OST0001_UUID 00000020:00000080:2.0:1784935630.413872:0:15812:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d1b0800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1784935630.413879:0:15812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:3.0:1784935630.414079:0:15171:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d1b6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1784935630.414232:0:15812:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6dcb3e6c-7883-4388-9dd1-46646343e0f5->MGS 00010000:00010000:2.0:1784935630.414335:0:15812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4541528000/0x857e02f4e0b1616b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b16172 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935630.414348:0:15812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528000/0x857e02f4e0b1616b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b16172 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935630.414354:0:15812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1784935630.414356:0:15812:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1784935630.414360:0:15812:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1784935630.414393:0:15812:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d455e1d4800 00010000:00010000:2.0:1784935630.414398:0:15812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4541528000/0x857e02f4e0b1616b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b16172 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935630.414428:0:15812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d000/0x857e02f4e0b16634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x857e02f4e0b1663b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935630.414435:0:15812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d000/0x857e02f4e0b16634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x857e02f4e0b1663b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935630.414441:0:15812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784935630.414443:0:15812:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1784935630.414445:0:15812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1784935630.414455:0:15812:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d455e1d4800 00010000:00010000:2.0:1784935630.414458:0:15812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4442a6d000/0x857e02f4e0b16634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x857e02f4e0b1663b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784935630.414485:0:15812:0:(import.c:65:import_set_state_nolock()) ffff8d455e1d4800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1784935630.414489:0:15812:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784935630.414491:0:15812:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784935630.414493:0:15812:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1784935630.414497:0:15812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784935630.414507:0:15812:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d4443dae300 x1871640292128128/t0(0) o250->MGC192.168.203.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784935648 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784935630.414528:0:15812:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784935630.414531:0:15812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:3.0:1784935630.414708:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6dcb3e6c-7883-4388-9dd1-46646343e0f5:3648:1871640292128128:0@lo:250:kworker.0 10000000:01000000:2.0:1784935630.414766:0:15812:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1784935630.414773:0:15812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16068 00000020:00000080:2.0:1784935630.414777:0:15812:0:(genops.c:906:class_export_put()) final put ffff8d4566e95800/6dcb3e6c-7883-4388-9dd1-46646343e0f5 00000020:01000000:2.0:1784935630.414798:0:15812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.128@tcp (flags='') 00000020:00000080:2.0:1784935630.414802:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935630.414807:0:15812:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.128@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784935630.414811:0:15812:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8d4572a3b380) has no exports 10000000:01000000:2.0:1784935630.414846:0:6523:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1784935630.414897:0:15812:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.128@tcp: client import never connected 00000100:00080000:2.0:1784935630.414900:0:15812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1784935630.414901:0:15812:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784935630.414903:0:15812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1784935630.414905:0:15812:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1784935630.414953:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784935630.414958:0:15812:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.128@tcp (uuid 6dcb3e6c-7883-4388-9dd1-46646343e0f5) 00000020:01000000:2.0:1784935630.414963:0:15812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1784935630.414965:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784935630.414968:0:15812:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784935630.414972:0:15812:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d44430bc800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784935630.414977:0:15812:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff8d457e88cd40) has exports, disconnecting them 00000020:00080000:2.0:1784935630.414981:0:15812:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d44430bc800), last request at 1784935414 00000020:00000080:2.0:1784935630.414984:0:15812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b1643c 00000020:00080000:2.0:1784935630.414992:0:15812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d44430bc800): rc 0 00000020:00000080:2.0:1784935630.414996:0:15812:0:(genops.c:906:class_export_put()) final put ffff8d44430bc800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1784935630.415881:0:15171:0:(genops.c:865:class_export_destroy()) destroying export ffff8d4566e95800/6dcb3e6c-7883-4388-9dd1-46646343e0f5 for MGC192.168.203.128@tcp 00000020:00000080:3.0:1784935630.415892:0:15171:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d455e1d4800 for MGC192.168.203.128@tcp 00000020:00000080:3.0:1784935630.415898:0:15171:0:(genops.c:906:class_export_put()) final put ffff8d455e1d2800/6dcb3e6c-7883-4388-9dd1-46646343e0f5 00000020:00000080:3.0:1784935630.415901:0:15171:0:(genops.c:865:class_export_destroy()) destroying export ffff8d455e1d2800/6dcb3e6c-7883-4388-9dd1-46646343e0f5 for MGC192.168.203.128@tcp 00000020:01000000:3.0:1784935630.415905:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.128@tcp (6dcb3e6c-7883-4388-9dd1-46646343e0f5) 00000020:00000080:3.0:1784935630.416549:0:15171:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44430bc800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1784935630.416573:0:15812:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1784935630.416577:0:15812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784935630.416581:0:15812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784935630.416586:0:15812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784935630.416697:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784935630.416704:0:15812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1784935630.416710:0:15812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1784935630.416715:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784935630.416718:0:15812:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784935630.416724:0:15812:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8d44430be800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784935630.416730:0:15812:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff8d457e88b380) has exports, disconnecting them 00000020:00080000:3.0:1784935630.416734:0:15812:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8d44430be800), last request at 1784935414 00000020:00000080:3.0:1784935630.416737:0:15812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b16451 00000020:00080000:3.0:1784935630.416749:0:15812:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d44430be800): rc 0 00000020:00000080:3.0:1784935630.416753:0:15812:0:(genops.c:906:class_export_put()) final put ffff8d44430be800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1784935630.420312:0:15171:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d44430bd800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1784935630.420330:0:15171:0:(genops.c:906:class_export_put()) final put ffff8d44430bd000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1784935630.420333:0:15171:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44430bd000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1784935630.420342:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1784935630.420405:0:15171:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44430be800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1784935630.461003:0:15812:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1784935630.461012:0:15812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784935630.461017:0:15812:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784935630.461024:0:15812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784935630.461057:0:15171:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d44430bf000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1784935630.469014:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1784935630.470510:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1784935630.471042:0:6509:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d455e3e8000:6509] 1 exiting: rc = 0 00000100:00100000:2.0:1784935630.472824:0:6508:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d45474b8600:6508] 0 exiting: rc = 1 00000100:00100000:1.0:1784935630.472882:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473405:0:6511:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d4566faee00:6511] 1 exiting: rc = 0 00000100:00100000:3.0:1784935630.473547:0:9527:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d457d07ba00:9527] 3 exiting: rc = 0 00000100:00100000:3.0:1784935630.473614:0:6512:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d4566faf800:6512] 2 exiting: rc = 0 00000100:00100000:2.0:1784935630.473779:0:6510:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d455e3e9400:6510] 0 exiting: rc = 1 00000100:00100000:1.0:1784935630.473836:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473844:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473890:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473897:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473910:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473916:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473923:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473956:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473964:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473971:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473976:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473981:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473987:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.473992:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474095:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474104:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474110:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474115:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474190:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474199:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474206:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474210:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474215:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474220:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474224:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474228:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474233:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474309:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474316:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474320:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474325:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474329:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474334:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474338:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474343:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474347:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474352:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474356:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474360:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474374:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474379:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474383:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474388:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474393:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474398:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474403:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474408:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474413:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474417:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474422:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474426:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474431:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474435:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474440:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474444:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474448:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474453:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474456:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474461:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474468:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474472:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474477:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474482:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.474486:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784935630.479248:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784935630.479260:0:15812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1784935630.479265:0:15812:0:(genops.c:906:class_export_put()) final put ffff8d44430b9800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1784935630.479271:0:15812:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44430b9800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1784935630.479276:0:15812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1784935630.479328:0:15812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457d24e000 1 00000020:00000080:1.0:1784935630.479334:0:15812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x857e02f4e0b163e1 00000020:00000080:1.0:1784935630.479339:0:15812:0:(genops.c:906:class_export_put()) final put ffff8d457e89c000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1784935630.479353:0:15812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1784935630.479365:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784935630.479370:0:15812:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784935630.479373:0:15812:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff8d44420999c0) has no exports 00000020:00000080:2.0:1784935630.479909:0:15171:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457e89c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1784935630.526723:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784935630.526739:0:15812:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1784935630.526744:0:15812:0:(genops.c:906:class_export_put()) final put ffff8d44428f0800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1784935630.526749:0:15812:0:(genops.c:865:class_export_destroy()) destroying export ffff8d44428f0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1784935630.526755:0:15812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1784935630.527237:0:15812:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d4581e8a800 00000020:01000000:1.0:1784935630.527259:0:15812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1784935630.527264:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784935630.527268:0:15812:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784935630.527271:0:15812:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8d4566f38000) has no exports 00000020:00000080:1.0:1784935630.527299:0:15812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784935630.527304:0:15812:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1784935630.527307:0:15812:0:(genops.c:906:class_export_put()) final put ffff8d457d249800/OSS_uuid 00000020:00000080:1.0:1784935630.527309:0:15812:0:(genops.c:865:class_export_destroy()) destroying export ffff8d457d249800/OSS_uuid for OSS 00000020:01000000:1.0:1784935630.527313:0:15812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1784935630.527513:0:6521:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1784935630.527816:0:8441:0:(service.c:3182:ptlrpc_main()) ll_ost00_002: service thread [ffff8d456de34600:8441] 2 exiting: rc = 0 00000100:00100000:3.0:1784935630.527868:0:8987:0:(service.c:3182:ptlrpc_main()) ll_ost00_003: service thread [ffff8d4442040400:8987] 3 exiting: rc = 0 00000100:00100000:3.0:1784935630.527964:0:8439:0:(service.c:3182:ptlrpc_main()) ll_ost00_000: service thread [ffff8d457d079400:8439] 0 exiting: rc = 1 00000100:00100000:0.0:1784935630.535897:0:8440:0:(service.c:3182:ptlrpc_main()) ll_ost00_001: service thread [ffff8d457d0edc00:8440] 1 exiting: rc = 0 00000100:00100000:1.0:1784935630.536597:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536609:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536617:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536624:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536631:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536636:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536641:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536646:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536650:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536655:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536660:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536665:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536670:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536675:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536680:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536685:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536707:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536712:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536717:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536721:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536726:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536730:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536734:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536739:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536743:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536748:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536753:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536877:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536885:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536890:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536894:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536899:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536905:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536910:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536914:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536920:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536924:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536956:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536961:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536966:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536971:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536975:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536980:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536985:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536990:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.536995:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537011:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537016:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537021:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537027:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537033:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537046:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537051:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537056:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537061:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537066:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537070:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537075:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537080:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537085:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537090:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537094:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537099:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.537114:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784935630.542142:0:8442:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d457d0ede00:8442] 0 exiting: rc = 1 00000100:00100000:1.0:1784935630.543710:0:13417:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8d44421bf400:13417] 2 exiting: rc = 0 00000100:00100000:2.0:1784935630.545381:0:8443:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d4566eb3400:8443] 1 exiting: rc = 0 00000100:00100000:0.0:1784935630.547171:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547181:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547188:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547193:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547198:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547203:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547209:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547214:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547219:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547224:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547229:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547234:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547240:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547245:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547250:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547255:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547260:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547281:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547286:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547291:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547296:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547300:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547307:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547313:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547318:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547323:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547328:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547333:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547338:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547342:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547346:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547351:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547355:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547360:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547364:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547369:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547373:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547378:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547383:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547388:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547393:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547398:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547402:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547407:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547411:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547416:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547420:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547425:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547429:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547433:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547438:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547442:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547455:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547459:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547465:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547471:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547476:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547481:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547486:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547491:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547497:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547502:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547508:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.547513:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.548375:0:8446:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d457d12ae00:8446] 2 exiting: rc = 0 00000100:00100000:1.0:1784935630.549060:0:8445:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d457d12b000:8445] 1 exiting: rc = 0 00000100:00100000:2.0:1784935630.549584:0:8444:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d45705d8200:8444] 0 exiting: rc = 1 00000100:00100000:0.0:1784935630.550401:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550410:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550416:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550421:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550426:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550431:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550437:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550442:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550448:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550454:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550459:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550466:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550472:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550480:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550485:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550509:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550517:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550522:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550528:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550533:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550538:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550543:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550563:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550569:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550574:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550579:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550584:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550591:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550596:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550602:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550608:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550614:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550620:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550626:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550631:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550637:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550642:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550647:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550653:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550671:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550678:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550684:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550689:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550695:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550700:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550705:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550711:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550717:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550722:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550728:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550734:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550740:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550745:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550751:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550756:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550762:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550767:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550783:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550800:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550807:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550812:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550818:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550825:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784935630.550832:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.556420:0:8448:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d4566ecde00:8448] 1 exiting: rc = 0 00000100:00100000:2.0:1784935630.556879:0:8447:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d4566ecd000:8447] 0 exiting: rc = 1 00000100:00100000:1.0:1784935630.558570:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558580:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558586:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558591:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558597:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558602:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558608:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558613:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558618:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558623:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558628:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558633:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558637:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558643:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558679:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558686:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558691:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558696:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558710:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558715:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558720:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558725:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558729:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558734:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558739:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558744:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558749:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558755:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558760:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558765:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558770:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558775:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558896:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558905:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558910:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558914:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558919:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558986:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.558995:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559000:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559004:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559009:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559014:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559018:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559023:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559028:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559033:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559038:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559043:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559049:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559054:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559059:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559064:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559078:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559083:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559087:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559092:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559097:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559102:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559107:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559112:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559117:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559122:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.559126:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784935630.560856:0:8449:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d457d12ca00:8449] 0 exiting: rc = 1 00000100:00100000:2.0:1784935630.560982:0:8450:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d457d12c400:8450] 1 exiting: rc = 0 00000100:00100000:1.0:1784935630.561066:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561075:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561585:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561600:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561607:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561613:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561619:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561636:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561642:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561648:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561654:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561661:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561666:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561671:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561677:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561682:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561688:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561693:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561699:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561722:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561729:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561736:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561743:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561748:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561769:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561774:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561781:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561797:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561802:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561808:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561815:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561835:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561842:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561848:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561853:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561859:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561864:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561871:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561876:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561881:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561887:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561893:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561898:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561921:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561959:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561966:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561972:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561980:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561985:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561992:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.561999:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562005:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562020:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562026:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562033:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562053:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562061:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562067:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562074:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562086:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562092:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562685:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562692:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784935630.562708:0:15812:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1784935630.575364:0:15812:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1784935648.118058:0:16577:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1784935658.630348:0:17177:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784935658.630354:0:17177:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1784935658.630356:0:17177:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784935658.630665:0:17177:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d4443cc0000 00000020:01000004:0.0:1784935658.630684:0:17177:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1784935658.630691:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784935658.630704:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d4581ed99c0) 00000020:00000080:0.0:1784935658.630717:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784935658.708022:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1784935658.723782:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784935658.726407:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1784935658.726817:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784935658.727025:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784935658.727221:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784935658.727417:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1784935658.727830:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1784935658.728095:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1784935658.728771:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.733140:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.735911:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.736464:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.736833:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.737102:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.737354:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.738597:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.739080:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.739289:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.739660:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.740175:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.740521:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.742005:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.742279:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.743066:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.743299:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.743564:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.744706:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.745027:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.745527:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.745805:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.746807:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784935658.747130:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.747524:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784935658.751057:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784935658.751252:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784935658.751711:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784935658.751910:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784935658.752223:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784935658.752644:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784935658.753889:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1784935658.754219:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784935658.754383:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1784935658.755686:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1784935658.756051:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784935658.756231:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784935658.761642:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1784935658.762859:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1784935658.763406:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1784935658.764773:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1784935658.765702:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1784935658.766281:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1784935658.773723:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:0.0:1784935658.774743:0:17177:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784935658.775415:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1784935658.775426:0:17177:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784935658.775514:0:17177:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b17625 00000020:01000004:0.0:1784935658.775524:0:17177:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1784935658.775530:0:17177:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1784935658.775703:0:17177:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d4443cc0000 from MGS 00000020:01000004:0.0:1784935658.775708:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1784935658.775719:0:17177:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d4581edcd40) 00000020:00000080:0.0:1784935658.775733:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1784935658.775799:0:17177:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d4443cc0000 from MGS, refs=2 00080000:01000000:0.0:1784935658.775804:0:17177:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784935658.775809:0:17177:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b17633 00000100:00100000:0.0:1784935658.775923:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1784935658.776060:0:17177:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1784935658.776066:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1784935658.780436:0:17177:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1784935658.780462:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784935658.781251:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784935658.781417:0:17177:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784935658.781424:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1784935658.786069:0:17177:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1784935658.786089:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1784935658.788788:0:17177:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1784935658.789025:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784935658.789880:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935658.789884:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935658.789886:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935658.790295:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935658.790298:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935658.790300:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935658.805008:0:17177:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1784935658.806760:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1784935658.820818:0:17177:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1784935658.822169:0:17189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784935658.822252:0:17177:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784935658.822292:0:17177:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784935658.824809:0:17177:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784935658.825153:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784935658.825296:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784935658.825302:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784935658.833208:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784935658.833221:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784935658.833812:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784935658.833819:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1784935658.834319:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1784935658.834337:0:17177:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.128@tcp' 00000020:01000004:0.0:1784935658.834339:0:17177:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1784935658.834365:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.128@tcp (typ=mgc) 00000020:00000080:0.0:1784935658.834377:0:17177:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.128@tcp (ffff8d4581edb380) 00000020:00000080:0.0:1784935658.834391:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1784935658.834459:0:17177:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d455e1d7000@MGC192.168.203.128@tcp: add connection 192.168.203.128@tcp at head 00000100:00080000:1.0:1784935658.834686:0:17193:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1784935658.834794:0:17177:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.128@tcp-0 is initialized 00000040:01000000:0.0:1784935658.834800:0:17177:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.128@tcp ctxt 1 is initialized 10000000:01000000:0.0:1784935658.836879:0:17194:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1784935658.837743:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.128@tcp (uuid 9c8b4eee-3769-4cc8-9dd4-4824356c9813) 00000020:00000080:1.0:1784935658.837770:0:17177:0:(genops.c:1406:class_connect()) connect: client 9c8b4eee-3769-4cc8-9dd4-4824356c9813, cookie 0x857e02f4e0b17641 00000100:00080000:1.0:1784935658.837783:0:17177:0:(import.c:510:import_select_connection()) MGC192.168.203.128@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784935658.837789:0:17177:0:(import.c:624:import_select_connection()) MGC192.168.203.128@tcp: import ffff8d455e1d7000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935658.837823:0:17177:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443dafb80 x1871640292128256/t0(0) o250->MGC192.168.203.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784935658.837848:0:17177:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9c8b4eee-3769-4cc8-9dd4-4824356c9813->MGS 00000020:01000004:1.0:1784935658.837868:0:17177:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784935658.837873:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784935658.837886:0:17177:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d44420999c0) 00000020:00000080:1.0:1784935658.837900:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1784935658.846067:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3648:1871640292128256:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1784935658.846140:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935658.847700:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292128256 00000100:00100000:0.0:1784935658.847714:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292128256 00000100:00100000:0.0:1784935658.847762:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784935658.847772:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3648:x1871640292128256:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1784935658.847803:0:17190:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 9c8b4eee-3769-4cc8-9dd4-4824356c9813@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1784935658.847839:0:17190:0:(genops.c:1406:class_connect()) connect: client 9c8b4eee-3769-4cc8-9dd4-4824356c9813, cookie 0x857e02f4e0b1764f 00000100:00080000:0.0:1784935658.847992:0:17190:0:(import.c:65:import_set_state_nolock()) ffff8d455e1d6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784935658.848091:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+5:3648:x1871640292128256:12345-0@lo:250:mount.lustre.0 Request processed in 319us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935658.848098:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935658.848718:0:3648:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.128@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1784935658.848728:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.128@tcp: connect to target with instance 0 00000100:00080000:3.0:1784935658.848735:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.128@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1784935658.848740:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1784935658.848744:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d455e1d7000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1784935658.848747:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1784935658.848771:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1784935658.848777:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3648:1871640292128256:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784935658.861264:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784935658.861430:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784935658.861436:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1784935658.865316:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1784935658.865330:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1784935658.867180:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1784935658.867191:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1784935658.879138:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784935658.879294:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1784935658.879307:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1784935658.893674:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1784935658.893693:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1784935658.967139:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784935658.967317:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1784935658.967323:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1784935658.973541:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1784935658.973557:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784935658.974300:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784935658.974459:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784935658.974465:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784935658.974976:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784935658.974984:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784935658.975755:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784935658.975888:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784935658.975893:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1784935658.986489:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784935658.990179:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1784935658.991905:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784935658.992114:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784935658.992119:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1784935659.003961:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784935659.003974:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784935659.059537:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935659.063080:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784935659.063088:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1784935659.066689:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784935659.066708:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784935659.074407:0:17177:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784935659.074421:0:17177:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784935659.079171:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784935659.079211:0:17177:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1784935659.079217:0:17177:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.128@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784935659.079320:0:17177:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784935659.079356:0:17177:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.128@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1784935659.079361:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784935659.079362:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784935659.079364:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935659.079365:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935659.079366:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935659.079367:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935659.079368:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784935659.079374:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784935659.079376:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935659.079377:0:17177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784935659.079379:0:17177:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1784935659.079381:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784935659.079382:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784935659.079383:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935659.079384:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935659.079385:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935659.079386:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935659.079387:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784935659.079388:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784935659.079389:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935659.079390:0:17177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784935659.079415:0:17177:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784935659.079436:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292128384:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784935659.079507:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935659.079570:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4566e1f000 going to sleep for 11 seconds 00000100:00100000:0.0:1784935659.079706:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292128384 00000100:00100000:0.0:1784935659.079713:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292128384 00000100:00100000:0.0:1784935659.079770:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784935659.079779:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+5:17177:x1871640292128384:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784935659.079830:0:17192:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784935659.079832:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784935659.079835:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1784935659.080393:0:17213:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784935659.080868:0:17192:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1784935659.083024:0:17214:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1784935659.083031:0:17214:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1784935659.083034:0:17214:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1784935659.083037:0:17214:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784935659.085856:0:17214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1784935659.086101:0:17192:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784935659.086111:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1784935659.092173:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+5:17177:x1871640292128384:12345-0@lo:253:mount.lustre.0 Request processed in 12385us (12656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935659.092193:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784935659.092294:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292128384:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784935659.092308:0:17177:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784935659.092312:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784935659.092313:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784935659.092314:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784935659.092316:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784935659.092317:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784935659.092318:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784935659.092319:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784935659.092321:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784935659.092322:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784935659.092324:0:17177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784935659.092341:0:17177:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d4443cc0000 from lustre-MDT0000 10000000:01000000:3.0:1784935659.092371:0:17177:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784935659.092374:0:17177:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784935659.092378:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d4581edb380 10000000:01000000:3.0:1784935659.092382:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784935659.092389:0:17177:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d4581edb380 from 1 10000000:01000000:3.0:1784935659.092392:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784935659.092440:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.092452:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.092461:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935659.092479:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292128512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784935659.092516:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.092558:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542adf540 going to sleep for 11 seconds 00000100:00100000:1.0:1784935659.092630:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292128512 00000100:00100000:1.0:1784935659.092638:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292128512 00000100:00100000:1.0:1784935659.092676:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784935659.092684:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+5:17177:x1871640292128512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784935659.092696:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935659.092708:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d1b8800/0x857e02f4e0b1765d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17656 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.092728:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b8800/0x857e02f4e0b1765d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17656 expref: 6 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.092738:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d1b8800/0x857e02f4e0b1765d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17656 expref: 6 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.092747:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8800, rc 0) 00000100:00100000:1.0:1784935659.092785:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+6:17177:x1871640292128512:12345-0@lo:101:mount.lustre.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935659.092798:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784935659.092869:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292128512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784935659.092881:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.092890:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935659.092972:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292128640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784935659.092996:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.093013:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542adf540 going to sleep for 11 seconds 00000100:00100000:1.0:1784935659.093454:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292128640 00000100:00100000:1.0:1784935659.093460:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292128640 00000100:00100000:1.0:1784935659.093491:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784935659.093500:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+6:17177:x1871640292128640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784935659.093604:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+6:17177:x1871640292128640:12345-0@lo:501:mount.lustre.0 Request processed in 96us (598us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784935659.093614:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784935659.093783:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292128640:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784935659.093811:0:17177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784935659.093831:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.093840:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935659.093855:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d4443cc0000 10000000:01000000:3.0:1784935659.093859:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784935659.093862:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d4443cc0000 10000000:01000000:3.0:1784935659.093865:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784935659.093867:0:17177:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8d4443cc0000 from 1 10000000:01000000:3.0:1784935659.093869:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784935659.093890:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020800/0x857e02f4e0b17664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.093896:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554020800/0x857e02f4e0b17664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.093903:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554020800/0x857e02f4e0b17664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935659.093915:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292128768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784935659.093971:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.093990:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542adf540 going to sleep for 11 seconds 00000100:00100000:0.0:1784935659.094038:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292128768 00000100:00100000:0.0:1784935659.094044:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292128768 00000100:00100000:0.0:1784935659.094076:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784935659.094083:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+6:17177:x1871640292128768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784935659.094091:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935659.094107:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443698400/0x857e02f4e0b1766b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17664 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.094123:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443698400/0x857e02f4e0b1766b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17664 expref: 7 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.094131:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443698400/0x857e02f4e0b1766b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17664 expref: 7 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.094137:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698400, rc 0) 00000100:00100000:0.0:1784935659.094166:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+7:17177:x1871640292128768:12345-0@lo:101:mount.lustre.0 Request processed in 84us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935659.094180:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784935659.094288:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292128768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784935659.094298:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554020800/0x857e02f4e0b17664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1766b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.094306:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554020800/0x857e02f4e0b17664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1766b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935659.094316:0:17177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784935659.094320:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020800/0x857e02f4e0b17664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1766b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.094332:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554020800/0x857e02f4e0b17664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1766b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935659.094338:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784935659.094341:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784935659.094346:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d4443cc0000 10000000:01000000:3.0:1784935659.094348:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784935659.094350:0:17177:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784935659.094352:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784935659.094365:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020a00/0x857e02f4e0b17672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.094373:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554020a00/0x857e02f4e0b17672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.094380:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554020a00/0x857e02f4e0b17672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935659.094391:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292128896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784935659.094414:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.094434:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542adf540 going to sleep for 11 seconds 00000100:00100000:0.0:1784935659.094517:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292128896 00000100:00100000:0.0:1784935659.094521:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292128896 00000100:00100000:0.0:1784935659.094549:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784935659.094556:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+7:17177:x1871640292128896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784935659.094562:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935659.094579:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443699400/0x857e02f4e0b17679 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17672 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.094592:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443699400/0x857e02f4e0b17679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17672 expref: 8 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.094608:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443699400/0x857e02f4e0b17679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17672 expref: 8 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.094615:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699400, rc 0) 00000100:00100000:0.0:1784935659.094649:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+8:17177:x1871640292128896:12345-0@lo:101:mount.lustre.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935659.094654:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784935659.094789:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292128896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784935659.094800:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554020a00/0x857e02f4e0b17672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17679 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.094808:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554020a00/0x857e02f4e0b17672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17679 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935659.094860:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292129024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784935659.094884:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.094903:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542adf540 going to sleep for 11 seconds 00000100:00100000:2.0:1784935659.094967:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292129024 00000100:00100000:2.0:1784935659.094972:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292129024 00000100:00100000:2.0:1784935659.095002:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784935659.095008:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+8:17177:x1871640292129024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935659.095125:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+9:17177:x1871640292129024:12345-0@lo:501:mount.lustre.0 Request processed in 116us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935659.095131:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784935659.095216:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292129024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784935659.095254:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292129152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784935659.095288:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.095313:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4542adf540 going to sleep for 11 seconds 00000100:00100000:2.0:1784935659.095385:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292129152 00000100:00100000:2.0:1784935659.095389:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292129152 00000100:00100000:2.0:1784935659.095418:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784935659.095424:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+9:17177:x1871640292129152:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784935659.096153:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+9:17177:x1871640292129152:12345-0@lo:503:mount.lustre.0 Request processed in 725us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935659.096161:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784935659.096292:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292129152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784935659.105426:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17215:1871640292129280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935659.105515:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935659.105573:0:17215:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432d3540 going to sleep for 11 seconds 00000100:00100000:0.0:1784935659.105686:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292129280 00000100:00100000:0.0:1784935659.105692:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292129280 00000100:00100000:0.0:1784935659.105741:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784935659.105750:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+9:17215:x1871640292129280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935659.108242:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+9:17215:x1871640292129280:12345-0@lo:502:llog_process_th.0 Request processed in 2485us (2718us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935659.108255:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784935659.108693:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17215:1871640292129280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935659.108733:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935659.108743:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935659.108746:0:17215:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784935659.108751:0:17215:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784935659.108754:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784935659.108768:0:17215:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d444209cd40) 00000020:00000080:1.0:1784935659.108785:0:17215:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1784935659.108791:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784935659.108891:0:17215:0:(osd_handler.c:8933:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784935659.108898:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b17687 00000020:00000080:1.0:1784935659.109213:0:17215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784935659.109217:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935659.109221:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935659.109222:0:17215:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784935659.109225:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935659.109235:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935659.109237:0:17215:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784935659.109240:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784935659.109247:0:17215:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d4442098000) 00000020:00000080:1.0:1784935659.109256:0:17215:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1784935659.109260:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784935659.109261:0:17215:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784935659.109264:0:17215:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784935659.109269:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784935659.109314:0:17215:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d4443cc0000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784935659.109326:0:17215:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d444209b380) 00000020:00000080:1.0:1784935659.109333:0:17215:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1784935659.109384:0:17215:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784935659.109390:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b1769c 00000020:00000080:1.0:1784935659.109472:0:17215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784935659.109478:0:17215:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784935659.109483:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x857e02f4e0b176a3 00080000:01000000:1.0:1784935659.109487:0:17215:0:(osd_handler.c:8933:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784935659.109492:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b176aa 00010000:00010000:3.0:1784935659.258697:0:17215:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1784935659.259296:0:17215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1784935659.259632:0:17215:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784935659.260164:0:17215:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d457b9799c0) 00000020:00000080:3.0:1784935659.260182:0:17215:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784935659.260264:0:17215:0:(osd_handler.c:8933:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784935659.260272:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b176b8 00000020:00000080:3.0:1784935659.260861:0:17215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784935659.265777:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x857e02f4e0b176bf 00000020:00000080:3.0:1784935659.266277:0:17215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784935659.266288:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935659.266294:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935659.266297:0:17215:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784935659.266300:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784935659.266303:0:17215:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1784935659.266304:0:17215:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784935659.266306:0:17215:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784935659.266308:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784935659.266317:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935659.266319:0:17215:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784935659.266322:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935659.266328:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935659.266329:0:17215:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784935659.266334:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784935659.266373:0:17215:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784935659.266388:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935659.266391:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935659.266392:0:17215:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784935659.266395:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935659.266397:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935659.266399:0:17215:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1784935659.266402:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784935659.266406:0:17215:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:00000080:3.0:1784935659.266430:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784935659.266444:0:17215:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8d457b97b380) 00000020:00000080:3.0:1784935659.266456:0:17215:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1784935659.266460:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784935659.266510:0:17215:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1784935659.266515:0:17215:0:(osd_handler.c:8933:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784935659.266520:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b176cd 00010000:00080000:3.0:1784935659.266550:0:17215:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4581e6c000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.128@tcp at head 00010000:00010000:3.0:1784935659.268206:0:17215:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1784935659.282480:0:17215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784935659.282495:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784935659.282538:0:17215:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784935659.282561:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b176d4 00000100:00080000:3.0:1784935659.282584:0:17215:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784935659.282590:0:17215:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d4581e6c000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935659.282666:0:17215:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574030e00 x1871640292129408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784935659.282711:0:17215:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1784935659.282784:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935659.282789:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935659.282790:0:17215:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1784935659.282794:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784935659.282796:0:17215:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1784935659.282798:0:17215:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784935659.282799:0:17215:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784935659.282801:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784935659.282803:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935659.282804:0:17215:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784935659.282806:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784935659.282811:0:17215:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784935659.282814:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935659.282816:0:17215:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784935659.282818:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784935659.282822:0:17215:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:01000000:3.0:1784935659.282845:0:17215:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784935659.282848:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784935659.282860:0:17215:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d457b978000) 00000020:00000080:3.0:1784935659.282870:0:17215:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1784935659.282874:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784935659.282950:0:17215:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1784935659.282956:0:17215:0:(osd_handler.c:8933:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784935659.282962:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b176e2 00010000:00080000:3.0:1784935659.282992:0:17215:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4581cd4000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.128@tcp at head 00010000:00010000:3.0:1784935659.283194:0:17215:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1784935659.283743:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292129408:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784935659.283815:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.284519:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292129408 00000100:00100000:3.0:1784935659.284528:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292129408 00000100:00100000:3.0:1784935659.284577:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935659.284585:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1871640292129408:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1784935659.284618:0:17202:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1784935659.302039:0:17215:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784935659.302429:0:17215:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784935659.310248:0:17215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935659.310676:0:17215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1784935659.317257:0:17215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1784935659.318049:0:17221:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784935659.318055:0:17221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784935659.318843:0:17215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784935659.318856:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784935659.318896:0:17215:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784935659.318916:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b176e9 00000100:00080000:2.0:1784935659.318959:0:17215:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784935659.318966:0:17215:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d4581cd4000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935659.319244:0:17215:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443cd6680 x1871640292129536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935659.319273:0:17215:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1784935659.319306:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292129536:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1784935659.319404:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935659.319409:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935659.319411:0:17215:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784935659.319414:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784935659.319416:0:17215:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1784935659.319418:0:17215:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784935659.319420:0:17215:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784935659.319421:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784935659.319423:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935659.319425:0:17215:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784935659.319427:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000400:00000100:0.0:1784935659.319486:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871640292129536 offset 0 length 520: 4 00000020:01000004:2.0:1784935659.319487:0:17215:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784935659.319492:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935659.319493:0:17215:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784935659.319496:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784935659.319500:0:17215:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:01000000:2.0:1784935659.319524:0:17215:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784935659.319527:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784935659.319539:0:17215:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d457e88b380) 00000020:00000080:2.0:1784935659.319551:0:17215:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1784935659.319556:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784935659.319631:0:17215:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784935659.319636:0:17215:0:(osd_handler.c:8933:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784935659.319643:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x857e02f4e0b176f7 00010000:00080000:2.0:1784935659.319668:0:17215:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4573e19000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.128@tcp at head 00010000:00010000:2.0:1784935659.319958:0:17215:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1784935659.320095:0:17215:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784935659.320110:0:17215:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1784935659.322267:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1871640292129408:12345-0@lo:38:llog_process_th.0 Request processed in 37676us (38445us total) trans 0 rc -19/-19 00000100:00080000:0.0:1784935659.322366:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581e6c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1784935659.322369:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1784935659.322372:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784935659.322376:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292129408:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1784935659.323256:0:17215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784935659.324073:0:17215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1784935659.324244:0:17215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1784935659.324849:0:17223:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784935659.324854:0:17223:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784935659.326460:0:17215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784935659.326473:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784935659.326512:0:17215:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784935659.326530:0:17215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b176fe 00000100:00080000:2.0:1784935659.326540:0:17215:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784935659.326546:0:17215:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d4573e19000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935659.326765:0:17215:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443cd6d80 x1871640292129664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935659.326831:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292129664:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784935659.326903:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871640292129664 offset 0 length 520: 4 00000100:00080000:2.0:1784935659.327150:0:17215:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784935659.327258:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935659.327264:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935659.327272:0:17215:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784935659.327277:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935659.327280:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935659.327282:0:17215:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784935659.327285:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784935659.327287:0:17215:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784935659.327289:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935659.327292:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935659.327293:0:17215:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784935659.327295:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935659.327298:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935659.327299:0:17215:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784935659.327303:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784935659.327332:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17215:1871640292129792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935659.327395:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935659.327425:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292129792 00000100:00100000:2.0:1784935659.327431:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292129792 00000100:00100000:2.0:1784935659.327467:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784935659.327474:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+9:17215:x1871640292129792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935659.327611:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+9:17215:x1871640292129792:12345-0@lo:502:llog_process_th.0 Request processed in 137us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935659.327619:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784935659.327662:0:17215:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45494646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935659.327681:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17215:1871640292129792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784935659.327715:0:17215:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935659.327719:0:17215:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935659.327720:0:17215:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784935659.327723:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1784935659.327892:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1784935659.327912:0:17177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784935659.327955:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020a00/0x857e02f4e0b17672 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17679 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.327966:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554020a00/0x857e02f4e0b17672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17679 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935659.327973:0:17177:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4443cc0000 from 1 10000000:01000000:3.0:1784935659.327976:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784935659.328002:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.328011:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.328020:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935659.328035:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292129920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784935659.328064:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.328088:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581e32b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784935659.329074:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292129920 00000100:00100000:2.0:1784935659.329084:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292129920 00000100:00100000:2.0:1784935659.329178:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784935659.329188:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+9:17177:x1871640292129920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784935659.329202:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935659.329219:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443201200/0x857e02f4e0b1770c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17705 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935659.329243:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443201200/0x857e02f4e0b1770c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17705 expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935659.329254:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443201200/0x857e02f4e0b1770c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17705 expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935659.329262:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201200, rc 0) 00000100:00100000:2.0:1784935659.329318:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+10:17177:x1871640292129920:12345-0@lo:101:mount.lustre.0 Request processed in 132us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935659.329325:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784935659.330225:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292129920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784935659.330247:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.330257:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935659.331047:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130048:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1784935659.331116:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.331157:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581e32b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935659.331248:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292130048 00000100:00100000:0.0:1784935659.331255:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292130048 00000100:00100000:0.0:1784935659.331302:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784935659.331312:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+10:17177:x1871640292130048:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1784935659.331332:0:17190:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784935659.331339:0:17190:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1784935659.331421:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+10:17177:x1871640292130048:12345-0@lo:256:mount.lustre.0 Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935659.331428:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784935659.331816:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130048:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784935659.334975:0:17177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784935659.335059:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.335072:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935659.335129:0:17177:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4443cc0000 from 1 10000000:01000000:1.0:1784935659.335132:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784935659.335179:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.335187:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.335198:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935659.335222:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784935659.335289:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935659.335331:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432d3180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935659.335547:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292130176 00000100:00100000:0.0:1784935659.335554:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292130176 00000100:00100000:0.0:1784935659.335632:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784935659.335641:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+10:17177:x1871640292130176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784935659.335654:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935659.335670:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b1771a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17713 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.335717:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b1771a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17713 expref: 11 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.335727:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b1771a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17713 expref: 11 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.335736:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699a00, rc 0) 00000100:00100000:0.0:1784935659.335773:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17177:x1871640292130176:12345-0@lo:101:mount.lustre.0 Request processed in 134us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935659.335780:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784935659.338018:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784935659.338046:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.338058:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935659.338167:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784935659.338217:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935659.338248:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432d3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784935659.338391:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292130304 00000100:00100000:2.0:1784935659.338398:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292130304 00000100:00100000:2.0:1784935659.338436:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784935659.338444:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17177:x1871640292130304:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935659.338613:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17177:x1871640292130304:12345-0@lo:501:mount.lustre.0 Request processed in 170us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935659.338621:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784935659.339260:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784935659.339298:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784935659.339361:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935659.339390:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432d3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784935659.339772:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292130432 00000100:00100000:2.0:1784935659.339778:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292130432 00000100:00100000:2.0:1784935659.339823:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784935659.339832:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17177:x1871640292130432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784935659.339973:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17177:x1871640292130432:12345-0@lo:503:mount.lustre.0 Request processed in 142us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935659.339986:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784935659.341127:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784935659.341908:0:17225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17225:1871640292130560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935659.342016:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935659.342055:0:17225:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432d3540 going to sleep for 11 seconds 00000100:00100000:2.0:1784935659.342203:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292130560 00000100:00100000:2.0:1784935659.342209:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292130560 00000100:00100000:2.0:1784935659.342247:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784935659.342255:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17225:x1871640292130560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784935659.343293:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17225:x1871640292130560:12345-0@lo:502:llog_process_th.0 Request processed in 1033us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935659.343302:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784935659.343451:0:17225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17225:1871640292130560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935659.343486:0:17225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935659.343495:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935659.343497:0:17225:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784935659.343505:0:17225:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4443cc0000 00000020:00000080:1.0:1784935659.343508:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935659.343515:0:17225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935659.343518:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935659.343519:0:17225:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784935659.343521:0:17225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935659.343524:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935659.343525:0:17225:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784935659.343528:0:17225:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4443cc0000 00000020:00000080:1.0:1784935659.343530:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935659.343610:0:17225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935659.343614:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935659.343615:0:17225:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1784935659.343618:0:17225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935659.343620:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935659.343621:0:17225:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784935659.343625:0:17225:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4443cc0000 00000020:00000080:1.0:1784935659.343627:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935659.343644:0:17225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935659.343647:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935659.343655:0:17225:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784935659.343658:0:17225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935659.343661:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935659.343662:0:17225:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1784935659.343666:0:17225:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4443cc0000 00000020:00000080:1.0:1784935659.343668:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784935659.343724:0:17225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17225:1871640292130688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935659.343764:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935659.343796:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292130688 00000100:00100000:1.0:1784935659.343802:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292130688 00000100:00100000:1.0:1784935659.343835:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784935659.343842:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17225:x1871640292130688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784935659.343955:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17225:x1871640292130688:12345-0@lo:502:llog_process_th.0 Request processed in 112us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935659.343962:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784935659.343998:0:17225:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541abe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784935659.344010:0:17225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17225:1871640292130688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784935659.344026:0:17225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935659.344030:0:17225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935659.344032:0:17225:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1784935659.344035:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1784935659.348381:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1784935659.348422:0:17177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784935659.348448:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.348462:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935659.348524:0:17177:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784935659.348526:0:17177:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d4443cc0000 10000000:01000000:0.0:1784935659.348529:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d4443cc0000 10000000:01000000:0.0:1784935659.348533:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784935659.348539:0:17177:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4443cc0000 from 1 10000000:01000000:0.0:1784935659.348542:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784935659.348579:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443698a00/0x857e02f4e0b17721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.348605:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443698a00/0x857e02f4e0b17721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.348627:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443698a00/0x857e02f4e0b17721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935659.348652:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784935659.348728:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935659.348765:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4566fc6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935659.349112:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292130816 00000100:00100000:0.0:1784935659.349120:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292130816 00000100:00100000:0.0:1784935659.349170:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784935659.349178:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17177:x1871640292130816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784935659.349191:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935659.349206:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443698800/0x857e02f4e0b17728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17721 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.349229:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443698800/0x857e02f4e0b17728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17721 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.349239:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443698800/0x857e02f4e0b17728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17721 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.349248:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698800, rc 0) 00000100:00100000:0.0:1784935659.349288:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17177:x1871640292130816:12345-0@lo:101:mount.lustre.0 Request processed in 110us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935659.349294:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784935659.349340:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784935659.349365:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443698a00/0x857e02f4e0b17721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17728 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.349380:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443698a00/0x857e02f4e0b17721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17728 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935659.349435:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784935659.349460:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935659.349480:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4566fc6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935659.349493:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292130944 00000100:00100000:0.0:1784935659.349496:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292130944 00000100:00100000:0.0:1784935659.349519:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784935659.349525:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17177:x1871640292130944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784935659.350025:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17177:x1871640292130944:12345-0@lo:501:mount.lustre.0 Request processed in 498us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935659.350032:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784935659.350068:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292130944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784935659.350097:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292131072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784935659.357855:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935659.357911:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d444236a600 going to sleep for 11 seconds 00000100:00100000:0.0:1784935659.357976:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292131072 00000100:00100000:0.0:1784935659.357985:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292131072 00000100:00100000:0.0:1784935659.358032:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784935659.358041:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17177:x1871640292131072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784935659.358175:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17177:x1871640292131072:12345-0@lo:503:mount.lustre.0 Request processed in 134us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935659.358183:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784935659.358251:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292131072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784935659.360301:0:17229:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17229:1871640292131200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935659.360389:0:17229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935659.360423:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292131200 00000100:00100000:0.0:1784935659.360430:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292131200 00000100:00100000:0.0:1784935659.360469:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784935659.360477:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17229:x1871640292131200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935659.360608:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17229:x1871640292131200:12345-0@lo:502:llog_process_th.0 Request processed in 130us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935659.360616:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784935659.360664:0:17229:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4566fc6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935659.360697:0:17229:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17229:1871640292131200:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1784935659.360756:0:17229:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784935659.360769:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d4581ed8000) 00000020:00000080:0.0:1784935659.360787:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1784935659.361491:0:17229:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d4443cc0000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784935659.361496:0:17229:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4443cc0000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784935659.361499:0:17229:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4443cc0000 4 00010000:00080000:0.0:1784935659.361527:0:17229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d444361d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.128@tcp at head 00010000:00010000:0.0:1784935659.370296:0:17229:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1784935659.371532:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784935659.372863:0:17229:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784935659.372881:0:17229:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x857e02f4e0b17736 00000100:00080000:0.0:1784935659.372892:0:17229:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784935659.372898:0:17229:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d444361d000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:0.0:1784935659.372969:0:17229:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443432680 x1871640292131328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784935659.373008:0:17229:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784935659.373755:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871640292131328:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784935659.373826:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.374810:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292131328 00000100:00100000:3.0:1784935659.374820:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292131328 00000100:00100000:3.0:1784935659.376825:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935659.376836:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1871640292131328:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784935659.376951:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1871640292131328:12345-0@lo:38:llog_process_th.0 Request processed in 114us (3124us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784935659.376959:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784935659.383053:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784935659.383068:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d444361d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784935659.383076:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784935659.383080:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871640292131328:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784935659.386156:0:17229:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17229:1871640292131456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935659.386234:0:17229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.386270:0:17229:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581e32b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935659.386294:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292131456 00000100:00100000:3.0:1784935659.386300:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292131456 00000100:00100000:3.0:1784935659.386336:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784935659.386350:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17229:x1871640292131456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935659.386489:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17229:x1871640292131456:12345-0@lo:502:llog_process_th.0 Request processed in 139us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935659.386497:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784935659.386552:0:17229:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17229:1871640292131456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935659.387811:0:17229:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17229:1871640292131584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784935659.387880:0:17229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935659.387910:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292131584 00000100:00100000:3.0:1784935659.387914:0:17229:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 11 seconds 00000100:00100000:0.0:1784935659.387917:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292131584 00000100:00100000:0.0:1784935659.389230:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784935659.389241:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17229:x1871640292131584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784935659.389384:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17229:x1871640292131584:12345-0@lo:502:llog_process_th.0 Request processed in 145us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935659.389392:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784935659.389410:0:17229:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17229:1871640292131584:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784935659.389441:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784935659.390363:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784935659.390389:0:17177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784935659.390439:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443698a00/0x857e02f4e0b17721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17728 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935659.390450:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443698a00/0x857e02f4e0b17721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17728 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784935659.390498:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784935659.390501:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784935659.390502:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935659.390503:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784935659.390504:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935659.390506:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935659.390507:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784935659.390508:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784935659.390513:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935659.390514:0:17177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784935659.390518:0:17177:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784935659.390520:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784935659.390521:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784935659.390522:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935659.390523:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784935659.390523:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935659.390524:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935659.390525:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784935659.390526:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784935659.390527:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935659.390528:0:17177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784935659.390548:0:17177:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784935659.390574:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292131712:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784935659.390631:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935659.390669:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4566fc60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935659.390872:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292131712 00000100:00100000:3.0:1784935659.390878:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292131712 00000100:00100000:3.0:1784935659.391317:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784935659.391327:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17177:x1871640292131712:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784935659.391351:0:17191:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784935659.391363:0:17191:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784935659.394054:0:17191:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784935659.394077:0:17191:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784935659.394167:0:17213:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784935659.394172:0:17213:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784935659.394191:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935659.394208:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4443201200/0x857e02f4e0b1770c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17705 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935659.394216:0:17213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935659.394251:0:17213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4443201200/0x857e02f4e0b1770c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b17705 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935659.394265:0:17213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4443201200/0x857e02f4e0b1770c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b17705 expref: 12 pid: 17191 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935659.394279:0:17213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292131840:0@lo:104: 00000100:00100000:2.0:1784935659.394337:0:17213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935659.394380:0:17213:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784935659.394443:0:17181:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292131840 00000100:00100000:3.0:1784935659.394450:0:17181:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292131840 00000100:00100000:3.0:1784935659.394493:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935659.394501:0:17181:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:17213:x1871640292131840:12345-0@lo:104: 00010000:00010000:3.0:1784935659.394514:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.394576:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784935659.394582:0:17181:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:17213:x1871640292131840:12345-0@lo:104: Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935659.394589:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1784935659.394617:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935659.394623:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.394631:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021000 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:3.0:1784935659.394635:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.394662:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784935659.394669:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935659.394674:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784935659.394709:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.394715:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784935659.394733:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.394740:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4554021000/0x857e02f4e0b17705 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1770c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.394755:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935659.394757:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935659.394758:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935659.394785:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292131968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784935659.394813:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935659.394883:0:17213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292131840:0@lo:104: 00010000:00010000:3.0:1784935659.394901:0:17213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935659.395063:0:17183:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292131968 00000100:00100000:1.0:1784935659.395068:0:17183:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292131968 00010000:00010000:1.0:1784935659.395090:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4443201200/0x857e02f4e0b1770c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17705 expref: 13 pid: 17191 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935659.395121:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784935659.395136:0:17183:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+13:3651:x1871640292131968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784935659.395147:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935659.395152:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4443201200/0x857e02f4e0b1770c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17705 expref: 13 pid: 17191 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.395161:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4443201200/0x857e02f4e0b1770c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b17705 expref: 13 pid: 17191 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.395175:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443201200/0x857e02f4e0b1770c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b17705 expref: 13 pid: 17191 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.395186:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.395192:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784935659.395203:0:17183:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001032752s 00010000:00010000:1.0:1784935659.395207:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.395213:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.395218:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.395223:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.395228:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200c00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935659.395236:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.395242:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.395253:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935659.395262:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935659.395291:0:17183:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:3651:x1871640292131968:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935659.395297:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935659.395795:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292131968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935659.395815:0:17213:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.395829:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935659.395836:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1773d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935659.397034:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17177:x1871640292131712:12345-0@lo:253:mount.lustre.0 Request processed in 5702us (6396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935659.397045:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935659.397163:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17177:1871640292131712:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784935659.397177:0:17177:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784935659.397180:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784935659.397182:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784935659.397183:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935659.397184:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784935659.397185:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935659.397186:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935659.397187:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784935659.397189:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784935659.397190:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935659.397191:0:17177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784935659.397204:0:17177:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1784935659.434160:0:17177:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1784935659.434783:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1784935659.435025:0:17238:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784935659.435037:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:2.0:1784935659.435308:0:17237:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1784935659.435318:0:17237:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1784935659.435494:0:17238:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1784935659.439953:0:17239:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8d4574033800 x1871640292132096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935659.439968:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00000040:00080000:0.0:1784935659.441984:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784935659.442075:0:17238:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1784935659.442397:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784935659.443197:0:17177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784935659.443643:0:17177:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784935659.443656:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784935659.444085:0:17177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784935659.445821:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784935659.446396:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784935659.446647:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1784935659.451308:0:17177:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1784935659.457328:0:17177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1784935659.459802:0:17177:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784935659.459847:0:17177:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadd4418ab988 00100000:10000000:3.0:1784935659.459856:0:17177:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1784935659.464225:0:17177:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784935659.464243:0:17177:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.128@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784935659.464261:0:17177:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784935659.464287:0:17177:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1784935659.467472:0:17177:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784935659.471308:0:17177:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784935659.821153:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784935660.402558:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784935660.462065:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 10000000:01000000:3.0:1784935660.653335:0:17194:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784935660.653344:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4443cc0000 from 7 10000000:01000000:3.0:1784935660.653349:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784935660.653395:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935660.653407:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935660.653418:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935660.653456:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292132224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784935660.653523:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935660.653641:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784935660.661809:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292132224 00000100:00100000:0.0:1784935660.661823:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292132224 00000100:00100000:0.0:1784935660.661885:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784935660.661893:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+11:17194:x1871640292132224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935660.661910:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935660.661949:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b1774b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17744 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935660.661976:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b1774b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17744 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935660.661986:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b1774b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17744 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935660.661995:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698c00, rc 0) 00000100:00100000:0.0:1784935660.662077:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17194:x1871640292132224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (8554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935660.662084:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784935660.662290:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292132224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935660.662308:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935660.662317:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935660.662380:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292132352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784935660.662414:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935660.662448:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1784935660.662622:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292132352 00000100:00100000:3.0:1784935660.662628:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292132352 00000100:00100000:3.0:1784935660.662657:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784935660.662663:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17194:x1871640292132352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784935660.662679:0:17190:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784935660.662699:0:17190:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784935660.662702:0:17190:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1784935660.662776:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17194:x1871640292132352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935660.662783:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784935660.663151:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292132352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784935660.663192:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784935660.663199:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935660.663208:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935660.845131:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784935661.424595:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784935661.488181:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:3.0:1784935661.876658:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935662.509891:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:3.0:1784935662.893242:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935663.533061:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:2.0:1784935663.920555:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784935664.021127:0:17481:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1784935664.557205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784935664.557212:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784935664.557216:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d4581e6c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784935664.557224:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 478 00000100:00080000:2.0:1784935664.557230:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784935664.557237:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d4581e6c000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935664.557261:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443cd7100 x1871640292132608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935664.557286:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935664.557289:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784935664.557292:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935664.557295:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784935664.557298:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784935664.557301:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784935664.557303:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d444361d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784935664.557308:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d444361d000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935664.557354:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443cd5c00 x1871640292132736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784935664.557464:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292132480:0@lo:400:kworker.0 00000100:00100000:3.0:1784935664.557535:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935664.557616:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292132480 00000100:00100000:3.0:1784935664.557622:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292132480 00000100:00100000:1.0:1784935664.557825:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292132608:0@lo:38:kworker.0 00000100:00100000:1.0:1784935664.557865:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935664.557891:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871640292132736:0@lo:38:kworker.0 00000100:00100000:1.0:1784935664.557916:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935664.557974:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292132608 00000100:00100000:1.0:1784935664.557978:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292132608 00000100:00100000:1.0:1784935664.557995:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784935664.558002:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1871640292132608:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784935664.558018:0:17203:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784935664.561672:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784935664.561703:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:3652:x1871640292132480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935664.561738:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00000100:00100000:3.0:1784935664.561806:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:3652:x1871640292132480:12345-0@lo:400:kworker.0 Request processed in 118us (4269us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935664.561812:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292132736 00000100:00100000:2.0:1784935664.561822:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292132736 00000100:00100000:2.0:1784935664.561865:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935664.561871:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1871640292132736:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784935664.561892:0:17199:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:2.0:1784935664.561945:0:17199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x857e02f4e0b17752 00000004:00100000:2.0:1784935664.561959:0:17199:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784935664.562070:0:17199:0:(import.c:65:import_set_state_nolock()) ffff8d4573e1d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784935664.562116:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871640292132736:12345-0@lo:38:kworker.0 Request processed in 244us (4199us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935664.562123:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935664.562169:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292132480:0@lo:400:kworker.0 00010000:00080000:0.0:1784935664.566952:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d4443cd5c00 x1871640292132736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784935664.566975:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784935664.566984:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784935664.566989:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784935664.566992:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d444361d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784935664.566999:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871640292132736:0@lo:38:kworker.0 00000100:00100000:3.0:1784935664.567284:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784935664.587214:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1871640292132608:12345-0@lo:38:kworker.0 Request processed in 29203us (29340us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784935664.587228:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1784935664.588382:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581e6c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784935664.588390:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784935664.588394:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292132608:0@lo:38:kworker.0 00010000:00010000:3.0:1784935664.942944:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784935665.166867:0:17534:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784935665.167144:0:17534:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784935665.582111:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:1.0:1784935665.972177:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784935666.250760:0:17584:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784935666.251085:0:17584:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784935666.609980:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:3.0:1784935666.990529:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935667.629231:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:1.0:1784935668.013049:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935668.653712:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:3.0:1784935669.037234:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935669.677245:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00000100:00080000:2.0:1784935669.678118:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784935669.678124:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784935669.678128:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d4581e6c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784935669.678135:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:2.0:1784935669.678141:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784935669.678148:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d4581e6c000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935669.678171:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443cd7b80 x1871640292132992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935669.678191:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935669.678210:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784935669.678212:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935669.678215:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784935669.678248:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935659/real 1784935659] req@ffff8d4443cd6d80 x1871640292129664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935669 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935669.678272:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4443cd6d80 x1871640292129664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935669 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935669.678281:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935659/real 1784935659] req@ffff8d4443cd6680 x1871640292129536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935669 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935669.678291:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4443cd6680 x1871640292129536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935669 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935669.678309:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292132992:0@lo:38:kworker.0 00000100:00100000:2.0:1784935669.678369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784935669.678419:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4573e19000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935669.678430:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784935669.678433:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292129664:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1784935669.678438:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581cd4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935669.678443:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784935669.678445:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292129536:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784935669.678475:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292132992 00000100:00100000:2.0:1784935669.678481:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292132992 00000100:00100000:2.0:1784935669.678512:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935669.678519:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1871640292132992:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784935669.678559:0:17202:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784935669.678788:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292133120:0@lo:400:kworker.0 00000100:00100000:0.0:1784935669.678819:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935669.678839:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935669.678845:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292132864:0@lo:400:kworker.0 00000100:00100000:0.0:1784935669.678870:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935669.678900:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292132864 00000100:00100000:0.0:1784935669.678904:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292132864 00000100:00100000:1.0:1784935669.678982:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784935669.678990:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:3650:x1871640292132864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935669.679039:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:3650:x1871640292132864:12345-0@lo:400:kworker.0 Request processed in 49us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935669.679055:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784935669.679103:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292132864:0@lo:400:kworker.0 00000100:00100000:3.0:1784935669.679233:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292133120 00000100:00100000:3.0:1784935669.679237:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292133120 00000100:00100000:3.0:1784935669.679273:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784935669.679280:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292133120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935669.679314:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292133120:12345-0@lo:400:kworker.0 Request processed in 35us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935669.679320:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1784935669.682662:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935669.682672:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784935669.682676:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d4581cd4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784935669.682685:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 478 00000100:00080000:3.0:1784935669.682690:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784935669.682696:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d4581cd4000 using connection 192.168.203.128@tcp/0@lo 00010000:00080000:1.0:1784935669.682720:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d4443cd5f80 x1871640292133120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935669.682746:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574032a00 x1871640292133248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784935669.682749:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292133120:0@lo:400:kworker.0 00000100:00080000:3.0:1784935669.682776:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935669.682779:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784935669.682795:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d4573e19000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784935669.682799:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 478 00000100:00080000:3.0:1784935669.682802:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784935669.682805:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d4573e19000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935669.682820:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574033480 x1871640292133376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935669.682986:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292133248:0@lo:8:kworker.0 00000400:00000100:0.0:1784935669.683035:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871640292133248 offset 0 length 520: 4 00000100:00100000:0.0:1784935669.683068:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292133376:0@lo:8:kworker.0 00000400:00000100:3.0:1784935669.683302:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871640292133376 offset 0 length 520: 4 00000100:00100000:3.0:1784935669.694418:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1871640292132992:12345-0@lo:38:kworker.0 Request processed in 15887us (16037us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784935669.694434:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1784935669.694609:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581e6c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935669.694614:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784935669.694618:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292132992:0@lo:38:kworker.0 00010000:00010000:1.0:1784935670.066444:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935670.701050:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:3.0:1784935671.085023:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784935671.661921:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784935671.733300:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:1.0:1784935672.109263:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784935672.714579:0:17929:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784935672.714582:0:17929:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1784935672.714584:0:17929:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784935672.714685:0:17929:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d4443d3b800 00000020:01000004:2.0:1784935672.714699:0:17929:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1784935672.714710:0:17929:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784935672.716661:0:17929:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8d457e88cd40) 00000020:00000080:2.0:1784935672.716688:0:17929:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1784935672.761226:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00100000:10000000:3.0:1784935672.805437:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784935672.805857:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.806921:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.807689:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.807908:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.808241:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.808497:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.808738:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.808973:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.809247:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.809503:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.809747:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.809963:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.810243:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.810503:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.810729:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.811037:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.811353:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.811707:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.811884:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.812639:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.812840:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.813148:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.813471:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.813798:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.814047:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.814447:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.814687:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.814919:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.815221:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.815562:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.815755:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.815995:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784935672.816285:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1784935672.817975:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784935672.818452:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1784935672.818845:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1784935672.819117:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784935672.819418:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1784935672.819701:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1784935672.819895:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1784935672.820217:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1784935672.820481:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1784935672.820696:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784935672.820901:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1784935672.821360:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1784935672.823618:0:17929:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784935672.823831:0:17929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1784935672.823840:0:17929:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784935672.823851:0:17929:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b17760 00000020:01000004:3.0:1784935672.823858:0:17929:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1784935672.823877:0:17929:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.128@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784935672.823880:0:17929:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784935672.823886:0:17929:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1784935672.823910:0:17929:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1784935672.823914:0:17929:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.128@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1784935672.837214:0:17929:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784935672.837266:0:17929:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.128@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1784935672.837272:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784935672.837273:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784935672.837274:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935672.837275:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935672.837276:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935672.837277:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935672.837279:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784935672.837281:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935672.837282:0:17929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784935672.837285:0:17929:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1784935672.837287:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784935672.837289:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784935672.837290:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784935672.837291:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784935672.837291:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784935672.837292:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784935672.837293:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784935672.837294:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784935672.837296:0:17929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784935672.837324:0:17929:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1784935672.837352:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292133504:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784935672.837436:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935672.837705:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45436ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1784935672.839899:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292133504 00000100:00100000:3.0:1784935672.839913:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292133504 00000100:00100000:3.0:1784935672.840223:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784935672.840236:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17929:x1871640292133504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784935672.840274:0:17190:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784935672.840278:0:17190:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1784935672.840285:0:17190:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1784935672.843307:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17929:x1871640292133504:12345-0@lo:253:mount.lustre.0 Request processed in 3064us (5860us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935672.843321:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784935672.843404:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292133504:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784935672.843419:0:17929:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1784935672.843422:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784935672.843423:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784935672.843424:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935672.843425:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784935672.843426:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935672.843428:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935672.843442:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784935672.843443:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935672.843445:0:17929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784935672.843463:0:17929:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d4443d3b800 from lustre-MDT0001 10000000:01000000:0.0:1784935672.843518:0:17929:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1784935672.843521:0:17929:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1784935672.843529:0:17929:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d4581edb380 local copy 00010000:00010000:0.0:1784935672.843541:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935672.843650:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292133632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784935672.843688:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935672.843730:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2840 going to sleep for 11 seconds 00000100:00100000:1.0:1784935672.843906:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292133632 00000100:00100000:1.0:1784935672.843912:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292133632 00000100:00100000:1.0:1784935672.843972:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784935672.843981:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17929:x1871640292133632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784935672.844065:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17929:x1871640292133632:12345-0@lo:501:mount.lustre.0 Request processed in 85us (376us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784935672.844072:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784935672.844228:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292133632:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784935672.844243:0:17929:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784935672.844401:0:17929:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784935672.844407:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.844418:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935672.844442:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d4443d3b800 10000000:01000000:3.0:1784935672.844446:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784935672.844451:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d4581edb380 10000000:01000000:3.0:1784935672.844454:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784935672.844457:0:17929:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8d4581edb380 from 1 10000000:01000000:3.0:1784935672.844461:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784935672.844488:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b17767 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.844496:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b17767 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.844518:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b17767 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935672.844534:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292133760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784935672.844578:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935672.844615:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e3a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935672.844619:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292133760 00000100:00100000:0.0:1784935672.844625:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292133760 00000100:00100000:0.0:1784935672.844662:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784935672.844670:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4561d1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+12:17929:x1871640292133760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784935672.844679:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935672.844693:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443699c00/0x857e02f4e0b1776e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17767 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935672.844713:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443699c00/0x857e02f4e0b1776e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17767 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935672.844723:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443699c00/0x857e02f4e0b1776e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17767 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935672.844732:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699c00, rc 0) 00000100:00100000:0.0:1784935672.844778:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4561d1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+13:17929:x1871640292133760:12345-0@lo:101:mount.lustre.0 Request processed in 108us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935672.844796:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784935672.845270:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292133760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784935672.845286:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b17767 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1776e expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.845295:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b17767 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1776e expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935672.845323:0:17929:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784935672.845395:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b17767 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1776e expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.845405:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554021a00/0x857e02f4e0b17767 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1776e expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935672.845415:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d4443d3b800 10000000:01000000:3.0:1784935672.845419:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784935672.845424:0:17929:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8d4443d3b800 from 1 10000000:01000000:3.0:1784935672.845426:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784935672.845460:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b17775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.845476:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b17775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.845484:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b17775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935672.845499:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292133888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784935672.845546:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935672.845577:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e3a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935672.845856:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292133888 00000100:00100000:0.0:1784935672.845862:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292133888 00000100:00100000:0.0:1784935672.845904:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784935672.845911:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4561d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+13:17929:x1871640292133888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784935672.845922:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935672.845952:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443699800/0x857e02f4e0b1777c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17775 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935672.845970:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443699800/0x857e02f4e0b1777c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17775 expref: 14 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935672.845978:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443699800/0x857e02f4e0b1777c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17775 expref: 14 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935672.845985:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699800, rc 0) 00000100:00100000:0.0:1784935672.846019:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4561d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+14:17929:x1871640292133888:12345-0@lo:101:mount.lustre.0 Request processed in 108us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935672.846024:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784935672.846071:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292133888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784935672.846082:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b17775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1777c expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935672.846090:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b17775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1777c expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935672.846439:0:17929:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784935672.850557:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b17775 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1777c expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935672.850592:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554021800/0x857e02f4e0b17775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1777c expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935672.850601:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1784935672.850608:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784935672.850614:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d4443d3b800 10000000:01000000:0.0:1784935672.850617:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784935672.850620:0:17929:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1784935672.850623:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784935672.850658:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443699000/0x857e02f4e0b17783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935672.850667:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443699000/0x857e02f4e0b17783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935672.850678:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443699000/0x857e02f4e0b17783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935672.850704:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292134016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784935672.850774:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935672.850864:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2840 going to sleep for 11 seconds 00000100:00100000:3.0:1784935672.852334:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292134016 00000100:00100000:3.0:1784935672.852345:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292134016 00000100:00100000:3.0:1784935672.852632:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784935672.852642:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+14:17929:x1871640292134016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784935672.852659:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935672.852685:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554021e00/0x857e02f4e0b1778a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17783 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.852710:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554021e00/0x857e02f4e0b1778a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17783 expref: 15 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.852733:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554021e00/0x857e02f4e0b1778a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17783 expref: 15 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.852742:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021e00, rc 0) 00000100:00100000:3.0:1784935672.852824:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+15:17929:x1871640292134016:12345-0@lo:101:mount.lustre.0 Request processed in 184us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935672.852831:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784935672.852923:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292134016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784935672.852968:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443699000/0x857e02f4e0b17783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1778a expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935672.852978:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443699000/0x857e02f4e0b17783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1778a expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784935672.854958:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1784935672.855882:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935672.861990:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1784935672.862043:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1784935672.862294:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1784935672.862311:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1784935672.862326:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1784935672.862351:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1784935672.862441:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1784935672.862462:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1784935672.862556:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1784935672.862573:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1784935672.862586:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1784935672.862599:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1784935672.862613:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1784935672.863309:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1784935672.863331:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1784935672.863346:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1784935672.863361:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1784935672.863458:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1784935672.863473:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1784935672.863565:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1784935672.863581:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1784935672.863612:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1784935672.863628:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1784935672.863659:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1784935672.863664:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1784935672.863774:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292134144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784935672.863837:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935672.863960:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2840 going to sleep for 11 seconds 00000100:00100000:3.0:1784935672.864280:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292134144 00000100:00100000:3.0:1784935672.864289:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292134144 00000100:00100000:3.0:1784935672.864449:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784935672.864460:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+15:17929:x1871640292134144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784935672.864671:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+15:17929:x1871640292134144:12345-0@lo:501:mount.lustre.0 Request processed in 212us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935672.864679:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784935672.864803:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292134144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784935672.864848:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292134272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784935672.864896:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935672.865065:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd000 going to sleep for 11 seconds 00000100:00100000:0.0:1784935672.865696:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292134272 00000100:00100000:0.0:1784935672.865705:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292134272 00000100:00100000:0.0:1784935672.865739:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784935672.865747:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d454650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+15:17929:x1871640292134272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784935672.866774:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d454650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+15:17929:x1871640292134272:12345-0@lo:503:mount.lustre.0 Request processed in 1022us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935672.866786:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784935672.866896:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292134272:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784935672.867388:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784935672.867491:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292134400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784935672.867553:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935672.867582:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd540 going to sleep for 11 seconds 00000100:00100000:0.0:1784935672.867898:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292134400 00000100:00100000:0.0:1784935672.867906:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292134400 00000100:00100000:0.0:1784935672.867963:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784935672.867971:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+15:17929:x1871640292134400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784935672.868793:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+15:17929:x1871640292134400:12345-0@lo:502:mount.lustre.0 Request processed in 821us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935672.868802:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784935672.868946:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292134400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784935672.869415:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1784935672.869442:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1784935672.869455:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1784935672.869467:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1784935672.869492:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1784935672.869516:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1784935672.869534:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1784935672.869546:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1784935672.869559:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1784935672.869570:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1784935672.869593:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1784935672.869606:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1784935672.869618:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1784935672.869636:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1784935672.869650:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1784935672.869661:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1784935672.869673:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1784935672.869685:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1784935672.869697:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1784935672.869709:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1784935672.869723:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1784935672.869739:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1784935672.869751:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1784935672.869763:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1784935672.869775:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1784935672.869786:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1784935672.869797:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1784935672.869809:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1784935672.869821:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1784935672.869834:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1784935672.869845:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1784935672.869857:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1784935672.869869:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1784935672.869881:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1784935672.869894:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1784935672.869907:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1784935672.869920:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1784935672.869971:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1784935672.869986:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1784935672.869999:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1784935672.870011:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1784935672.870023:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1784935672.870035:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1784935672.870802:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1784935672.870860:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292134528:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784935672.871306:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935672.871397:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1ef6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935672.871629:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292134528 00000100:00100000:3.0:1784935672.871637:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292134528 00000100:00100000:3.0:1784935672.871727:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784935672.871737:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+15:17929:x1871640292134528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784935672.871875:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+15:17929:x1871640292134528:12345-0@lo:502:mount.lustre.0 Request processed in 137us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935672.871882:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784935672.871985:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292134528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784935672.872060:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1784935672.872072:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1784935672.873406:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935672.873419:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935672.873421:0:17933:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1784935672.873426:0:17933:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1784935672.873429:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784935672.873443:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8d4566f38000) 00000020:00000080:1.0:1784935672.873464:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1784935672.873470:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784935672.873575:0:17933:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784935672.873584:0:17933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b17798 00000020:00000080:1.0:1784935672.873768:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1784935672.873773:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935672.873776:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935672.873778:0:17933:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1784935672.873780:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935672.873784:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935672.873785:0:17933:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1784935672.873789:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784935672.873796:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8d4566f399c0) 00000020:00000080:1.0:1784935672.873808:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1784935672.873811:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784935672.873813:0:17933:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1784935672.873816:0:17933:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1784935672.873821:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784935672.873873:0:17933:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d4443d3b800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1784935672.873885:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8d4566f3cd40) 00000020:00000080:1.0:1784935672.873893:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1784935672.873999:0:17933:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784935672.874006:0:17933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b177ad 00000020:00000080:1.0:1784935672.874113:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1784935672.874129:0:17933:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784935672.874134:0:17933:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x857e02f4e0b177b4 00080000:01000000:1.0:1784935672.874140:0:17933:0:(osd_handler.c:8933:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784935672.874143:0:17933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b177bb 00010000:00010000:3.0:1784935672.950689:0:17933:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1784935672.951325:0:17933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1784935672.951725:0:17933:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784935672.952838:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1784935672.952851:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935672.952857:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935672.952859:0:17933:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1784935672.952863:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935672.952868:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935672.952869:0:17933:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1784935672.952872:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784935672.952877:0:17933:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:00000080:2.0:1784935672.952903:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784935672.952916:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8d457e8899c0) 00000020:00000080:2.0:1784935672.952958:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1784935672.952964:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784935672.953038:0:17933:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1784935672.953045:0:17933:0:(osd_handler.c:8933:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784935672.953052:0:17933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b177c9 00010000:00080000:2.0:1784935672.953085:0:17933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d457032d800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.128@tcp at head 00010000:00010000:2.0:1784935672.958673:0:17933:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1784935672.963710:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784935672.963726:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784935672.963763:0:17933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784935672.963786:0:17933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b177d0 00000100:00080000:3.0:1784935672.963797:0:17933:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784935672.963803:0:17933:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d457032d800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935672.963840:0:17933:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574030380 x1871640292134656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784935672.963902:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292134656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784935672.963998:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935672.964094:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292134656 00000100:00100000:1.0:1784935672.964101:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292134656 00000100:00100000:1.0:1784935672.964138:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784935672.964145:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1871640292134656:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784935672.964168:0:17203:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:1.0:1784935672.964196:0:17203:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b177d7 00000004:00100000:1.0:1784935672.964210:0:17203:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1784935672.964215:0:17203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1784935672.964362:0:17933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1784935672.964428:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935672.964433:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935672.964434:0:17933:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1784935672.964437:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784935672.964440:0:17933:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1784935672.964441:0:17933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784935672.964442:0:17933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784935672.964444:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784935672.964446:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935672.964447:0:17933:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784935672.964449:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935672.964453:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935672.964455:0:17933:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1784935672.964459:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784935672.964502:0:17933:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784935672.964525:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935672.964529:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935672.964530:0:17933:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1784935672.964533:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784935672.964534:0:17933:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1784935672.964544:0:17933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784935672.964546:0:17933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784935672.964548:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784935672.964551:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935672.964552:0:17933:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784935672.964554:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784935672.964558:0:17933:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1784935672.964561:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935672.964562:0:17933:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784935672.964566:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784935672.964569:0:17933:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:01000000:3.0:1784935672.964588:0:17933:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1784935672.964591:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784935672.964603:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d457b97cd40) 00000020:00000080:3.0:1784935672.964614:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1784935672.964619:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784935672.964680:0:17933:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1784935672.964686:0:17933:0:(osd_handler.c:8933:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784935672.964692:0:17933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b177e5 00010000:00080000:3.0:1784935672.964718:0:17933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4581e88000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.128@tcp at head 00010000:00010000:3.0:1784935672.964954:0:17933:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1784935672.966054:0:17933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:2.0:1784935672.966325:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784935672.966330:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784935672.966334:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d4581e6c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784935672.966342:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1784935672.966346:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784935672.966353:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d4581e6c000 using connection 192.168.203.128@tcp/0@lo 00000040:01000000:3.0:1784935672.966455:0:17933:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1784935672.966571:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443cd6d80 x1871640292134784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935672.966629:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292134784:0@lo:38:kworker.0 00000100:00100000:0.0:1784935672.966694:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935672.966769:0:17202:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1784935672.966778:0:17202:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1784935672.966885:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292134784 00000100:00100000:1.0:1784935672.966891:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292134784 00000100:00100000:1.0:1784935672.966993:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784935672.967000:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1871640292134784:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1784935672.967071:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935672.967076:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784935672.967078:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935672.967081:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784935672.967121:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292134912:0@lo:400:kworker.0 00000100:00100000:2.0:1784935672.967158:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935672.967196:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292134912 00000100:00100000:2.0:1784935672.967200:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292134912 00000100:00100000:2.0:1784935672.967229:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935672.967235:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292134912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935672.967275:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292134912:12345-0@lo:400:kworker.0 Request processed in 39us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935672.967282:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784935672.967317:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d4443cd7480 x1871640292134912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935672.967331:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292134912:0@lo:400:kworker.0 00000040:00080000:3.0:1784935672.968985:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784935672.969220:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1784935672.969443:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1784935672.969881:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1871640292134784:12345-0@lo:38:kworker.0 Request processed in 2874us (3180us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784935672.969893:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1784935672.970695:0:17939:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784935672.970701:0:17939:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1784935672.971081:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784935672.971091:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581e6c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784935672.971097:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784935672.971101:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292134784:0@lo:38:kworker.0 00000020:00000080:0.0:1784935672.972604:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784935672.972617:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784935672.972661:0:17933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784935672.972683:0:17933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b177ec 00000100:00080000:0.0:1784935672.972692:0:17933:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784935672.972698:0:17933:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d4581e88000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:0.0:1784935672.972734:0:17933:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443433100 x1871640292135040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935672.972767:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292135040:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784935672.972819:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871640292135040 offset 0 length 520: 4 00000100:00080000:0.0:1784935672.972867:0:17933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784935672.972949:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935672.972954:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935672.972956:0:17933:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784935672.972959:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784935672.972962:0:17933:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1784935672.972963:0:17933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784935672.972964:0:17933:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784935672.972965:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784935672.972968:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935672.972969:0:17933:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784935672.972971:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784935672.972975:0:17933:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1784935672.972977:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935672.972979:0:17933:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784935672.972989:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784935672.972993:0:17933:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.128@tcp to nid 0x20000c0a8cb80 (192.168.203.128@tcp) 00000020:01000000:0.0:1784935672.973015:0:17933:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1784935672.973018:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784935672.973040:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d45745ccd40) 00000020:00000080:0.0:1784935672.973054:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1784935672.973060:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784935672.973128:0:17933:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1784935672.973135:0:17933:0:(osd_handler.c:8933:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784935672.973141:0:17933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x857e02f4e0b177fa 00010000:00080000:0.0:1784935672.973169:0:17933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d455126f800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.128@tcp at head 00010000:00010000:0.0:1784935672.973359:0:17933:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1784935672.973422:0:17933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784935672.973438:0:17933:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1784935672.975171:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935672.975179:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935672.975182:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935672.975184:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1784935672.975667:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784935672.975871:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1784935672.976299:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1784935672.976797:0:17941:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784935672.976801:0:17941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784935672.977607:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784935672.977620:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784935672.977664:0:17933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784935672.977686:0:17933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b17801 00000100:00080000:3.0:1784935672.977697:0:17933:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784935672.977703:0:17933:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d455126f800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935672.977750:0:17933:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574030e00 x1871640292135168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784935672.977811:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292135168:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784935672.977866:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871640292135168 offset 0 length 520: 4 00000100:00080000:3.0:1784935672.977921:0:17933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784935672.978007:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935672.978010:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935672.978012:0:17933:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784935672.978015:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935672.978018:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935672.978019:0:17933:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784935672.978022:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784935672.978024:0:17933:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784935672.978026:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935672.978028:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935672.978029:0:17933:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784935672.978031:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935672.978033:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935672.978034:0:17933:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784935672.978038:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784935672.978058:0:17933:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935672.978061:0:17933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935672.978062:0:17933:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784935672.978064:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1784935672.978231:0:17929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1784935672.978262:0:17929:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784935672.978286:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443699000/0x857e02f4e0b17783 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1778a expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.978298:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443699000/0x857e02f4e0b17783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1778a expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935672.978312:0:17929:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4443d3b800 from 1 10000000:01000000:2.0:1784935672.978315:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784935672.978342:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.978350:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.978360:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935672.978388:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784935672.978424:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935672.978442:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45436fff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784935672.978463:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292135296 00000100:00100000:2.0:1784935672.978470:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292135296 00000100:00100000:2.0:1784935672.978535:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784935672.978544:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+15:17929:x1871640292135296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784935672.978557:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935672.978568:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443200000/0x857e02f4e0b1780f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17808 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.978589:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443200000/0x857e02f4e0b1780f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17808 expref: 16 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.978599:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443200000/0x857e02f4e0b1780f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17808 expref: 16 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.978620:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200000, rc 0) 00000100:00100000:2.0:1784935672.978656:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+16:17929:x1871640292135296:12345-0@lo:101:mount.lustre.0 Request processed in 112us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935672.978662:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784935672.978711:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784935672.978725:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.978733:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935672.979310:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135424:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1784935672.979350:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935672.979370:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45436fff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784935672.979390:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292135424 00000100:00100000:2.0:1784935672.979395:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292135424 00000100:00100000:2.0:1784935672.979425:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784935672.979432:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+16:17929:x1871640292135424:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784935672.979450:0:17191:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784935672.979468:0:17191:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784935672.979472:0:17191:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1784935672.979564:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+16:17929:x1871640292135424:12345-0@lo:256:mount.lustre.0 Request processed in 132us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935672.979572:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784935672.979612:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135424:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1784935672.980185:0:17929:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784935672.980194:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.980204:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935672.980212:0:17929:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4443d3b800 from 1 10000000:01000000:2.0:1784935672.980215:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784935672.980238:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.980245:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.980253:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935672.980267:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784935672.980293:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935672.980309:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45506f6240 going to sleep for 11 seconds 00000100:00100000:2.0:1784935672.980328:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292135552 00000100:00100000:2.0:1784935672.980333:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292135552 00000100:00100000:2.0:1784935672.980359:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784935672.980366:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+16:17929:x1871640292135552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784935672.980375:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935672.980385:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443200600/0x857e02f4e0b1781d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17816 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.980415:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443200600/0x857e02f4e0b1781d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17816 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.980424:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443200600/0x857e02f4e0b1781d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17816 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.980433:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200600, rc 0) 00000100:00100000:2.0:1784935672.980462:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17929:x1871640292135552:12345-0@lo:101:mount.lustre.0 Request processed in 97us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935672.980469:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784935672.980520:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784935672.980533:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.980540:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784935672.980655:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784935672.980683:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935672.980710:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935672.980723:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45412ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1784935672.980737:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292135680 00000100:00100000:2.0:1784935672.980741:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292135680 00000100:00100000:2.0:1784935672.980763:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784935672.980769:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17929:x1871640292135680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935672.980840:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17929:x1871640292135680:12345-0@lo:501:mount.lustre.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935672.980854:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784935672.980888:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935672.980910:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784935672.980968:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935672.980981:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45412ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1784935672.980996:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292135808 00000100:00100000:2.0:1784935672.980999:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292135808 00000100:00100000:2.0:1784935672.981019:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784935672.981024:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17929:x1871640292135808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784935672.981104:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17929:x1871640292135808:12345-0@lo:503:mount.lustre.0 Request processed in 78us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935672.981110:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784935672.981149:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135808:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784935672.981451:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1784935672.981720:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935672.981725:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784935672.981728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935672.981731:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784935672.981901:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135936:0@lo:502:mount.lustre.0 00000100:00080000:3.0:1784935672.982052:0:17203:0:(import.c:65:import_set_state_nolock()) ffff8d4570ce8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784935672.982293:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1871640292134656:12345-0@lo:38:llog_process_th.0 Request processed in 18146us (18293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935672.982312:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784935672.982436:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935672.982520:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4561fb7240 going to sleep for 11 seconds 00000100:00100000:0.0:1784935672.982654:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784935672.982664:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1784935672.982672:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1784935672.982678:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784935672.982681:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d457032d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784935672.982702:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292134656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784935672.982823:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292136064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935672.982860:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935672.982982:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292136064 00000100:00100000:1.0:1784935672.982988:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292136064 00000100:00100000:1.0:1784935672.983079:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784935672.983087:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1871640292136064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784935672.983114:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784935672.983154:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1871640292136064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935672.983161:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784935672.983916:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292136064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784935672.984072:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292135936 00000100:00100000:3.0:1784935672.984078:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292135936 00000100:00100000:3.0:1784935672.984150:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784935672.984158:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17929:x1871640292135936:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784935672.984289:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17929:x1871640292135936:12345-0@lo:502:mount.lustre.0 Request processed in 132us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935672.984297:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784935672.984382:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292135936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784935672.984639:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1784935672.984670:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1784935672.984746:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1784935672.984763:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1784935672.984776:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1784935672.984788:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1784935672.984801:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1784935672.984814:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1784935672.984826:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1784935672.984840:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1784935672.984855:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1784935672.984890:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784935672.984963:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935672.985708:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292136192 00000100:00100000:2.0:1784935672.985715:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292136192 00000100:00100000:2.0:1784935672.985749:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784935672.985756:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17929:x1871640292136192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935672.985871:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17929:x1871640292136192:12345-0@lo:502:mount.lustre.0 Request processed in 114us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935672.985879:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784935672.986017:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44433f1300 going to sleep for 11 seconds 00000100:00100000:2.0:1784935672.986037:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784935672.986092:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1784935672.986102:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1784935672.986663:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935672.986673:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935672.986676:0:17943:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784935672.986684:0:17943:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4443d3b800 00000020:00000080:2.0:1784935672.986687:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784935672.986696:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935672.986698:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935672.986700:0:17943:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784935672.986702:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935672.986705:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935672.986706:0:17943:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784935672.986709:0:17943:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d4443d3b800 00000020:00000080:2.0:1784935672.986711:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784935672.986776:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935672.986780:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935672.986781:0:17943:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784935672.986783:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935672.986785:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935672.986787:0:17943:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784935672.986790:0:17943:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4443d3b800 00000020:00000080:2.0:1784935672.986792:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784935672.986809:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935672.986812:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935672.986813:0:17943:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784935672.986824:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784935672.986826:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935672.986828:0:17943:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784935672.986831:0:17943:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d4443d3b800 00000020:00000080:2.0:1784935672.986833:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784935672.986856:0:17943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784935672.986860:0:17943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784935672.986862:0:17943:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784935672.986864:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1784935672.988561:0:17929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1784935672.988603:0:17929:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784935672.988628:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.988640:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935672.988697:0:17929:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784935672.988699:0:17929:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d4443d3b800 10000000:01000000:3.0:1784935672.988702:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d4443d3b800 10000000:01000000:3.0:1784935672.988707:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784935672.988712:0:17929:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d4443d3b800 from 1 10000000:01000000:3.0:1784935672.988715:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784935672.988748:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020400/0x857e02f4e0b17824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.988756:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554020400/0x857e02f4e0b17824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935672.988768:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554020400/0x857e02f4e0b17824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935672.988798:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784935672.988863:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935672.988902:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e1fae40 going to sleep for 11 seconds 00000100:00100000:2.0:1784935672.989019:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292136320 00000100:00100000:2.0:1784935672.989025:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292136320 00000100:00100000:2.0:1784935672.989071:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784935672.989080:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17929:x1871640292136320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784935672.989093:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935672.989104:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443201600/0x857e02f4e0b1782b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17824 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.989125:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443201600/0x857e02f4e0b1782b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17824 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.989136:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443201600/0x857e02f4e0b1782b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17824 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.989144:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443201600, rc 0) 00000100:00100000:2.0:1784935672.989186:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292136320:12345-0@lo:101:mount.lustre.0 Request processed in 107us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935672.989192:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784935672.989241:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784935672.989254:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554020400/0x857e02f4e0b17824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1782b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935672.989270:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554020400/0x857e02f4e0b17824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1782b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784935672.993069:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1784935672.993355:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784935672.994792:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1784935672.994825:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1784935672.994839:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1784935672.994854:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1784935672.994867:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1784935672.994877:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1784935672.994888:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1784935672.994899:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1784935672.994911:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1784935672.994960:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1784935672.994984:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1784935672.994997:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1784935672.995025:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1784935672.995039:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1784935672.995050:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1784935672.995061:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1784935672.995072:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1784935672.995083:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1784935672.995095:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1784935672.995106:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1784935672.995118:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1784935672.995131:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1784935672.995142:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1784935672.995155:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1784935672.995168:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1784935672.995180:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1784935672.995203:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1784935672.995216:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1784935672.995248:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1784935672.995255:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1784935672.995350:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935672.999111:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935672.999158:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4561fb7540 going to sleep for 11 seconds 00000100:00100000:2.0:1784935672.999201:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292136448 00000100:00100000:2.0:1784935672.999209:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292136448 00000100:00100000:2.0:1784935672.999259:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784935672.999267:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292136448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935673.000715:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292136448:12345-0@lo:501:mount.lustre.0 Request processed in 1441us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935673.000728:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784935673.000819:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935673.000873:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784935673.000920:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935673.000966:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549a570c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935673.001072:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292136576 00000100:00100000:1.0:1784935673.001078:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292136576 00000100:00100000:1.0:1784935673.001115:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784935673.001122:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292136576:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784935673.001232:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292136576:12345-0@lo:503:mount.lustre.0 Request processed in 109us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935673.001239:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784935673.004576:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136576:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784935673.005020:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784935673.005103:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935673.005172:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935673.005210:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549a570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935673.005350:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292136704 00000100:00100000:3.0:1784935673.005357:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292136704 00000100:00100000:3.0:1784935673.005414:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784935673.005423:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292136704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784935673.007519:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292136704:12345-0@lo:502:mount.lustre.0 Request processed in 2078us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935673.007532:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784935673.007767:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784935673.008079:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1784935673.008117:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1784935673.008135:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1784935673.008149:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1784935673.008162:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1784935673.008177:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1784935673.008192:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1784935673.008206:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1784935673.008218:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1784935673.008232:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1784935673.008246:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1784935673.008259:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1784935673.008274:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1784935673.008304:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1784935673.008320:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1784935673.008333:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1784935673.008346:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1784935673.008360:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1784935673.008566:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1784935673.008579:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1784935673.008591:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1784935673.008604:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1784935673.008616:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1784935673.008630:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1784935673.008643:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1784935673.008654:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1784935673.008665:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1784935673.008678:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1784935673.008692:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1784935673.008720:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1784935673.008735:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1784935673.008749:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1784935673.008762:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1784935673.008775:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1784935673.008800:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1784935673.008813:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1784935673.008827:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1784935673.008840:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1784935673.008853:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1784935673.008864:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1784935673.008876:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1784935673.008889:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1784935673.008901:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1784935673.008913:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1784935673.008952:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1784935673.008981:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1784935673.008997:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1784935673.009011:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1784935673.009065:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935673.009134:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935673.009175:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549a570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935673.011583:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292136832 00000100:00100000:3.0:1784935673.011598:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292136832 00000100:00100000:3.0:1784935673.011650:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784935673.011659:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4560ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292136832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784935673.011817:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4560ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292136832:12345-0@lo:502:mount.lustre.0 Request processed in 158us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935673.011826:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784935673.012036:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784935673.012221:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1784935673.012249:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1784935673.012283:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935673.012323:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935673.012352:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292136960 00000100:00100000:2.0:1784935673.012357:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292136960 00000100:00100000:2.0:1784935673.012729:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784935673.012737:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292136960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935673.012821:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292136960:12345-0@lo:502:mount.lustre.0 Request processed in 85us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935673.012828:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784935673.022018:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549a570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935673.022061:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292136960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784935673.022151:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1784935673.022164:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1784935673.023561:0:17948:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1784935673.023577:0:17948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8d457e888000) 00000020:00000080:2.0:1784935673.023601:0:17948:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1784935673.023763:0:17948:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d4443d3b800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784935673.023768:0:17948:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d4443d3b800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784935673.023771:0:17948:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d4443d3b800 3 00010000:00080000:2.0:1784935673.023799:0:17948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d4570c41000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.128@tcp at head 00010000:00010000:2.0:1784935673.029010:0:17948:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1784935673.029119:0:17948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1784935673.029163:0:17948:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784935673.029177:0:17948:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x857e02f4e0b17839 00000100:00080000:2.0:1784935673.029187:0:17948:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784935673.029193:0:17948:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d4570c41000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935673.029227:0:17948:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443cd5500 x1871640292137088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935673.029256:0:17948:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784935673.029290:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935673.029295:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784935673.029298:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935673.029301:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784935673.032227:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871640292137088:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784935673.032301:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935673.034517:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292137088 00000100:00100000:2.0:1784935673.034531:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292137088 00000100:00100000:2.0:1784935673.034581:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935673.034597:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1871640292137088:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784935673.034625:0:17199:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1784935673.034667:0:17199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x857e02f4e0b17840 00000004:00100000:2.0:1784935673.034683:0:17199:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784935673.034715:0:17199:0:(import.c:65:import_set_state_nolock()) ffff8d45492df000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784935673.034797:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871640292137088:12345-0@lo:38:llog_process_th.0 Request processed in 201us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935673.034804:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784935673.034847:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d4443cd5500 x1871640292137088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935673.034859:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784935673.034867:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1784935673.034873:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784935673.034878:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784935673.034880:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4570c41000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784935673.034885:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871640292137088:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1784935673.040741:0:17948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1784935673.040905:0:17929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784935673.041359:0:17929:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784935673.042974:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020400/0x857e02f4e0b17824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1782b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935673.042987:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554020400/0x857e02f4e0b17824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1782b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784935673.043045:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784935673.043047:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784935673.043052:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935673.043053:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935673.043054:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935673.043056:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935673.043057:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784935673.043059:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935673.043060:0:17929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784935673.043063:0:17929:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1784935673.043066:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784935673.043067:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784935673.043068:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935673.043069:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935673.043070:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935673.043071:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935673.043072:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784935673.043073:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935673.043074:0:17929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784935673.043099:0:17929:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1784935673.043118:0:17929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292137216:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784935673.043185:0:17929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935673.043223:0:17929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549464a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784935673.043246:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292137216 00000100:00100000:1.0:1784935673.043253:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292137216 00000100:00100000:1.0:1784935673.043296:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784935673.043305:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292137216:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784935673.043331:0:17190:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784935673.043344:0:17190:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1784935673.047834:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1784935673.047877:0:17190:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784935673.047888:0:17190:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1784935673.048459:0:17213:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784935673.048465:0:17213:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784935673.048896:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.048914:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b1774b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17744 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.048967:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4443200000/0x857e02f4e0b1780f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17808 expref: 18 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.048974:0:17213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.049013:0:17213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4443200000/0x857e02f4e0b1780f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b17808 expref: 18 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.049029:0:17213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4443200000/0x857e02f4e0b1780f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b17808 expref: 18 pid: 17190 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935673.049045:0:17213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292137344:0@lo:104: 00000100:00100000:2.0:1784935673.051480:0:17213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784935673.051572:0:17213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b1774b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b17744 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.051587:0:17213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b1774b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b17744 expref: 18 pid: 17192 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935673.051602:0:17213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292137472:0@lo:104: 00000100:00100000:2.0:1784935673.051638:0:17213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935673.051663:0:17213:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45474cef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784935673.051697:0:17181:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292137344 00000100:00100000:2.0:1784935673.051704:0:17181:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292137344 00000100:00100000:2.0:1784935673.051741:0:17181:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292137472 00000100:00100000:2.0:1784935673.051761:0:17181:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292137472 00000100:00100000:2.0:1784935673.051778:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935673.051786:0:17181:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+4:17213:x1871640292137344:12345-0@lo:104: 00010000:00010000:2.0:1784935673.051806:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.051859:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784935673.051865:0:17181:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+4:17213:x1871640292137344:12345-0@lo:104: Request processed in 80us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935673.051872:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935673.051893:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935673.051901:0:17181:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:17213:x1871640292137472:12345-0@lo:104: 00010000:00010000:2.0:1784935673.051908:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.051972:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784935673.051978:0:17181:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:17213:x1871640292137472:12345-0@lo:104: Request processed in 80us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935673.051984:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1784935673.051999:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784935673.052005:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.052012:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935673.052016:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.052024:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935673.052031:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935673.052043:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935673.052071:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.052077:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935673.052096:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.052103:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b17808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1780f expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.052114:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935673.052117:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.052123:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021600 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:2.0:1784935673.052126:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.052134:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784935673.052140:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935673.052145:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784935673.052158:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.052164:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784935673.052177:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.052183:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4554021600/0x857e02f4e0b17744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1774b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.052198:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935673.052199:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935673.052201:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935673.052209:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935673.052226:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292137600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935673.052255:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935673.052285:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784935673.052302:0:17183:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292137600 00000100:00100000:0.0:1784935673.052308:0:17183:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292137600 00010000:00010000:0.0:1784935673.052329:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4443200000/0x857e02f4e0b1780f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17808 expref: 19 pid: 17190 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935673.052353:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784935673.052360:0:17183:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:3649:x1871640292137600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784935673.052423:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935673.052430:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4443200000/0x857e02f4e0b1780f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17808 expref: 19 pid: 17190 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935673.052441:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4443200000/0x857e02f4e0b1780f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b17808 expref: 19 pid: 17190 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935673.052456:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935673.052485:0:17183:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:3649:x1871640292137600:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935673.052501:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935673.054556:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292137728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935673.054627:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935673.054686:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292137600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935673.054763:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17929:x1871640292137216:12345-0@lo:253:mount.lustre.0 Request processed in 11459us (11577us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935673.054774:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1784935673.054823:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443200000/0x857e02f4e0b1780f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b17808 expref: 17 pid: 17190 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935673.054837:0:17213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292137344:0@lo:104: 00000100:00100000:2.0:1784935673.054847:0:17213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292137472:0@lo:104: 00010000:00010000:2.0:1784935673.054866:0:17213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935673.055225:0:17929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17929:1871640292137216:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784935673.055237:0:17929:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1784935673.055240:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784935673.055241:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784935673.055243:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935673.055244:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935673.055245:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935673.055247:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935673.055258:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784935673.055260:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935673.055261:0:17929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784935673.055272:0:17929:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1784935673.055529:0:17185:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292137728 00000100:00100000:3.0:1784935673.055536:0:17185:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292137728 00010000:00010000:3.0:1784935673.055568:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b1774b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17744 expref: 17 pid: 17192 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935673.055592:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784935673.055600:0:17185:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:3649:x1871640292137728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935673.055613:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935673.055626:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b1774b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17744 expref: 17 pid: 17192 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935673.055636:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b1774b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b17744 expref: 17 pid: 17192 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935673.055650:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b1774b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b17744 expref: 17 pid: 17192 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935673.055663:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935673.055671:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784935673.055687:0:17185:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007222081s 00010000:00010000:3.0:1784935673.055692:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935673.055698:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935673.055705:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935673.055711:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935673.055717:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935673.055721:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935673.055741:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935673.055754:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935673.055763:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935673.055802:0:17185:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+16:3649:x1871640292137728:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935673.055809:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935673.056611:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292137728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784935673.056647:0:17213:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.056655:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935673.056661:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443201e00/0x857e02f4e0b17847 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1784935673.064348:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1784935673.064442:0:17954:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1784935673.064446:0:17954:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1784935673.065085:0:17955:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784935673.065487:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1784935673.066219:0:17956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1871640292137856:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784935673.066305:0:17956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935673.066336:0:17956:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581cc13c0 going to sleep for 11 seconds 00000040:01000000:2.0:1784935673.066565:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1784935673.066601:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784935673.067014:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292137856 00000100:00100000:3.0:1784935673.067022:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292137856 00000100:00100000:3.0:1784935673.067074:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784935673.067083:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17956:x1871640292137856:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784935673.067166:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17956:x1871640292137856:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 84us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935673.067173:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784935673.067491:0:17956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1871640292137856:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1784935673.067530:0:17956:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784935673.067565:0:17956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1871640292137984:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784935673.067600:0:17956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935673.067628:0:17956:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4561758f00 going to sleep for 11 seconds 00000004:00000080:2.0:1784935673.067720:0:17929:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784935673.067729:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1784935673.067788:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784935673.068494:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292137984 00000100:00100000:3.0:1784935673.068511:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292137984 00000100:00100000:3.0:1784935673.068552:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784935673.068561:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17956:x1871640292137984:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784935673.068695:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17956:x1871640292137984:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 135us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935673.068703:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784935673.068848:0:17956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1871640292137984:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784935673.068916:0:17956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17956:1871640292138112:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1784935673.068978:0:17956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935673.068999:0:17956:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4561758180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935673.069146:0:17208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292138112 00000100:00100000:0.0:1784935673.069151:0:17208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292138112 00000040:00080000:2.0:1784935673.069697:0:17929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784935673.070328:0:17929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784935673.070362:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1784935673.070527:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784935673.071018:0:17929:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:0.0:1784935673.071541:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784935673.071556:0:17208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17956:x1871640292138112:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1784935673.071653:0:17208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17956:x1871640292138112:12345-0@lo:900:lod0001_rec0000.0 Request processed in 101us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935673.071660:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784935673.071965:0:17956:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d4443daf800 x1871640292138112/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784935689 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935673.071982:0:17956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17956:1871640292138112:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1784935673.072050:0:17956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1871640292138240:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784935673.072089:0:17956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935673.072120:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292138240 00000100:00100000:2.0:1784935673.072126:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292138240 00000100:00100000:2.0:1784935673.072161:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935673.072175:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17956:x1871640292138240:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784935673.072230:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17956:x1871640292138240:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 56us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935673.072237:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935673.072258:0:17956:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432dc000 going to sleep for 11 seconds 00000100:00100000:2.0:1784935673.072271:0:17956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1871640292138240:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1784935673.072313:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784935673.074360:0:17956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784935673.074436:0:17956:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1784935673.074904:0:17955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784935673.077724:0:17955:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784935673.077831:0:17955:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784935673.077835:0:17955:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1784935673.079922:0:17929:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1784935673.081629:0:17929:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784935673.081666:0:17929:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffadd441c8b988 00100000:10000000:1.0:1784935673.081673:0:17929:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1784935673.082739:0:17929:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784935673.082768:0:17929:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.128@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784935673.082788:0:17929:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1784935673.082805:0:17929:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1784935673.087704:0:17929:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784935673.087924:0:17929:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784935673.135520:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935673.773989:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00000040:00080000:2.0:1784935674.099749:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784935674.157115:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784935674.221061:0:17194:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784935674.221069:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4443d3b800 from 8 10000000:01000000:2.0:1784935674.221075:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784935674.221122:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935674.221134:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935674.221145:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935674.221170:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292138368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784935674.221250:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935674.221324:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432dccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935674.221545:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292138368 00000100:00100000:3.0:1784935674.221552:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292138368 00000100:00100000:3.0:1784935674.221605:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784935674.221615:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+16:17194:x1871640292138368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935674.221628:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935674.221641:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554021c00/0x857e02f4e0b17855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1784e expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935674.221665:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554021c00/0x857e02f4e0b17855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1784e expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935674.221675:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554021c00/0x857e02f4e0b17855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1784e expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935674.221683:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021c00, rc 0) 00000100:00100000:3.0:1784935674.221730:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17194:x1871640292138368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935674.221737:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784935674.221861:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292138368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784935674.221900:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935674.221908:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935674.221975:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292138496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784935674.222005:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935674.222033:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432dccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935674.222086:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292138496 00000100:00100000:1.0:1784935674.222096:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292138496 00000100:00100000:1.0:1784935674.222130:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784935674.222137:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17194:x1871640292138496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784935674.222151:0:17190:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784935674.222166:0:17190:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784935674.222169:0:17190:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1784935674.222261:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17194:x1871640292138496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935674.222267:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784935674.222394:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292138496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784935674.222434:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784935674.222441:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935674.222450:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935674.222459:0:17194:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784935674.222461:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4443cc0000 from 8 10000000:01000000:2.0:1784935674.222463:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784935674.222481:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935674.222488:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935674.222504:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935674.222527:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292138624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784935674.222551:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935674.222571:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44432dccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935674.222620:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292138624 00000100:00100000:1.0:1784935674.222625:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292138624 00000100:00100000:1.0:1784935674.222655:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784935674.222661:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17194:x1871640292138624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935674.222668:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935674.222677:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b1785c expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935674.222691:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b1785c expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935674.222698:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1785c expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935674.222704:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9800, rc 0) 00000100:00100000:1.0:1784935674.222744:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17194:x1871640292138624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935674.222750:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784935674.222824:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292138624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935674.222835:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935674.222842:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935674.222881:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292138752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784935674.222963:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935674.222982:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44410de6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935674.223037:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292138752 00000100:00100000:2.0:1784935674.223042:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292138752 00000100:00100000:2.0:1784935674.223060:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784935674.223066:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17194:x1871640292138752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784935674.223076:0:17190:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784935674.223087:0:17190:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784935674.223090:0:17190:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1784935674.223163:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17194:x1871640292138752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935674.223170:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784935674.223298:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292138752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784935674.223332:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784935674.223338:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935674.223349:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935674.798745:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00000040:00080000:2.0:1784935675.120227:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784935675.182003:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935675.822533:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:2.0:1784935676.205505:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935676.845772:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:3.0:1784935677.229109:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784935677.745256:0:18198:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784935677.871993:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 0 seconds 00010000:00010000:1.0:1784935678.253152:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935678.383048:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1784935678.383087:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:2.0:1784935678.383105:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784935678.383126:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292139008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935678.383191:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784935678.383294:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784935678.383298:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d4581e6c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935678.383307:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d4581e6c000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935678.383330:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443dadf80 x1871640292139136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784935678.383354:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935678.383358:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784935678.383360:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935678.383363:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784935678.383379:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935678.383382:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784935678.383384:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935678.383387:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784935678.383412:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292139008 00000100:00100000:1.0:1784935678.383418:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292139008 00000100:00100000:1.0:1784935678.383463:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784935678.383483:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292139008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784935678.383514:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784935678.383559:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292139008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935678.383581:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784935678.383626:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292139008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935678.383753:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292139136:0@lo:38:kworker.0 00000100:00100000:2.0:1784935678.383781:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935678.383829:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292139264:0@lo:400:kworker.0 00000100:00100000:2.0:1784935678.383855:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935678.383882:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935678.383888:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292139392:0@lo:400:kworker.0 00000100:00100000:2.0:1784935678.383909:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935678.383958:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292139264 00000100:00100000:2.0:1784935678.383962:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292139264 00000100:00100000:2.0:1784935678.383989:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292139392 00000100:00100000:2.0:1784935678.383991:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292139392 00000100:00100000:2.0:1784935678.384004:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935678.384010:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292139264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935678.384043:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292139264:12345-0@lo:400:kworker.0 Request processed in 33us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935678.384049:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935678.384060:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784935678.384066:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292139392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935678.384088:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292139392:12345-0@lo:400:kworker.0 Request processed in 23us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935678.384094:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784935678.384117:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4443dac000 x1871640292139392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935678.384127:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292139392:0@lo:400:kworker.0 00010000:00080000:2.0:1784935678.384136:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4443dace00 x1871640292139264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935678.384144:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292139264:0@lo:400:kworker.0 00000100:00100000:1.0:1784935678.384222:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292139136 00000100:00100000:1.0:1784935678.384226:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292139136 00000100:00100000:1.0:1784935678.384252:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784935678.384257:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1871640292139136:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784935678.384276:0:17938:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:1.0:1784935678.384407:0:17938:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b1786a 00000004:00100000:1.0:1784935678.384420:0:17938:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1784935678.384425:0:17938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1784935678.384621:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292138880:0@lo:400:kworker.0 00000100:00100000:2.0:1784935678.384654:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935678.384766:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292138880 00000100:00100000:1.0:1784935678.384771:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292138880 00000100:00100000:1.0:1784935678.384839:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784935678.384848:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:3652:x1871640292138880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935678.384891:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:3652:x1871640292138880:12345-0@lo:400:kworker.0 Request processed in 47us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935678.384898:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784935678.384957:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292138880:0@lo:400:kworker.0 00000100:00080000:1.0:1784935678.402659:0:17938:0:(import.c:65:import_set_state_nolock()) ffff8d457d1b0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935678.402762:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1871640292139136:12345-0@lo:38:kworker.0 Request processed in 18500us (18976us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935678.402774:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1784935678.403669:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784935678.403680:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1784935678.403686:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784935678.403690:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581e6c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1784935678.403718:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005a53cc10): req@ffff8d4574033800 x1871640292132096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935678.403736:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292139136:0@lo:38:kworker.0 00000100:00100000:1.0:1784935678.404020:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935678.404045:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0300 going to sleep for 11 seconds 00000100:00100000:1.0:1784935678.404060:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292132096 00000100:00100000:1.0:1784935678.404064:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292132096 00000100:00100000:1.0:1784935678.404101:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784935678.404119:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17239:x1871640292132096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784935678.404192:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17239:x1871640292132096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 73us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935678.404199:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784935678.404227:0:17239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17239:1871640292132096:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1784935678.404256:0:17239:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784935678.404382:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292139520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935678.404411:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935678.405001:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292139520 00000100:00100000:0.0:1784935678.405008:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292139520 00000100:00100000:0.0:1784935678.405038:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784935678.405045:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1871640292139520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935678.405071:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784935678.405114:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1871640292139520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935678.405120:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784935678.405153:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292139520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784935678.405372:0:17239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17239:1871640292139648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784935678.405410:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935678.405490:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4544dda240 going to sleep for 11 seconds 00000100:00100000:0.0:1784935678.408870:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292139648 00000100:00100000:0.0:1784935678.408884:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292139648 00000100:00100000:0.0:1784935678.408950:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784935678.408960:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17239:x1871640292139648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784935678.409142:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17239:x1871640292139648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 183us (3730us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935678.409150:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784935678.409308:0:17239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17239:1871640292139648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784935678.409410:0:17239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17239:1871640292139776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784935678.409462:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935678.409494:0:17239:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935678.409691:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292139776 00000100:00100000:0.0:1784935678.409696:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292139776 00000100:00100000:0.0:1784935678.409727:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784935678.409733:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17239:x1871640292139776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784935678.409793:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17239:x1871640292139776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935678.409800:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784935678.413199:0:17239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17239:1871640292139776:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784935678.413268:0:17239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784935678.415322:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784935678.415392:0:17239:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1784935678.415404:0:17239:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1784935678.719377:0:18250:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784935678.719838:0:18250:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784935679.278189:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784935679.870808:0:18302:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784935679.871049:0:18302:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784935680.304338:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784935680.737297:0:18350:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe556a3350 20000000:00000080:0.0:1784935680.737315:0:18350:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d4544890000 uarg=0000000000000000 20000000:01000000:0.0:1784935680.737355:0:18350:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1784935680.737362:0:18350:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1784935680.737366:0:18350:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1784935680.737868:0:18351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1784935680.738306:0:18350:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784935680.743718:0:18350:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784935680.743758:0:18350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.743779:0:18350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b1771a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17713 expref: 17 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.743787:0:18350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4443200600/0x857e02f4e0b1781d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17816 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.743795:0:18350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.743840:0:18350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4443200600/0x857e02f4e0b1781d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b17816 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.743876:0:18350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4443200600/0x857e02f4e0b1781d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b17816 expref: 17 pid: 17192 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935680.743894:0:18350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18350:1871640292139904:0@lo:104: 00000100:00100000:0.0:1784935680.744576:0:18350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784935680.744674:0:18350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b1771a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b17713 expref: 17 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935680.744684:0:18350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b1771a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b17713 expref: 17 pid: 17190 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935680.744695:0:18350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18350:1871640292140032:0@lo:104: 00000100:00100000:0.0:1784935680.744719:0:18350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935680.746359:0:18350:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454913f840 going to sleep for 11 seconds 00000100:00100000:1.0:1784935680.746501:0:17182:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292139904 00000100:00100000:1.0:1784935680.746510:0:17182:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292139904 00000100:00100000:1.0:1784935680.746547:0:17182:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292140032 00000100:00100000:1.0:1784935680.746550:0:17182:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292140032 00000100:00100000:1.0:1784935680.746565:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784935680.746573:0:17182:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+4:18350:x1871640292139904:12345-0@lo:104: 00010000:00010000:1.0:1784935680.746589:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.746706:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784935680.746713:0:17182:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+4:18350:x1871640292139904:12345-0@lo:104: Request processed in 141us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935680.746720:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784935680.746737:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784935680.746742:0:17182:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:18350:x1871640292140032:12345-0@lo:104: 00010000:00010000:1.0:1784935680.746750:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.746785:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784935680.746789:0:17182:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:18350:x1871640292140032:12345-0@lo:104: Request processed in 48us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935680.746795:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784935680.746810:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784935680.746826:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.746834:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935680.746839:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.746847:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935680.746855:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935680.746861:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784935680.746897:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.746904:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935680.746947:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.746956:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b17816 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1781d expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.746968:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784935680.746971:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.746976:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8c00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935680.746979:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.746996:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935680.747002:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935680.747006:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784935680.747019:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.747025:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935680.747041:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.747048:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17713 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1771a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935680.747060:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935680.747062:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935680.747063:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935680.747077:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935680.747088:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292140160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935680.747121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784935680.747188:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935680.747203:0:17185:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292140160 00000100:00100000:3.0:1784935680.747207:0:17185:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292140160 00010000:00010000:3.0:1784935680.747230:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4443200600/0x857e02f4e0b1781d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17816 expref: 18 pid: 17192 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935680.747260:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784935680.747268:0:17185:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:3651:x1871640292140160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935680.747278:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935680.747283:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4443200600/0x857e02f4e0b1781d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17816 expref: 18 pid: 17192 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747294:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4443200600/0x857e02f4e0b1781d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b17816 expref: 18 pid: 17192 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747310:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935680.747340:0:17185:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:3651:x1871640292140160:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935680.747346:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784935680.747378:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292140160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935680.747526:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292140288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935680.747554:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935680.747621:0:17184:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292140288 00000100:00100000:3.0:1784935680.747626:0:17184:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292140288 00010000:00010000:3.0:1784935680.747640:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b1771a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17713 expref: 18 pid: 17190 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935680.747669:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784935680.747675:0:17184:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:3649:x1871640292140288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784935680.747683:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784935680.747693:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b1771a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17713 expref: 18 pid: 17190 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747702:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b1771a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b17713 expref: 18 pid: 17190 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747714:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747722:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747736:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747743:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747749:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747756:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747761:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935680.747765:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747773:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747782:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935680.747798:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784935680.747828:0:17184:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:3649:x1871640292140288:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935680.747834:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784935680.747859:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292140288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784935680.748125:0:18350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443200600/0x857e02f4e0b1781d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b17816 expref: 17 pid: 17192 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935680.748143:0:18350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18350:1871640292139904:0@lo:104: 00010000:00010000:0.0:1784935680.748157:0:18350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b1771a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b17713 expref: 16 pid: 17190 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935680.748166:0:18350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18350:1871640292140032:0@lo:104: 00010000:00010000:0.0:1784935680.748183:0:18350:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935680.748192:0:18350:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935680.748197:0:18350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935680.748203:0:18350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d1b8600/0x857e02f4e0b17871 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935681.326533:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784935681.902349:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1784935682.028997:0:17194:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784935682.029005:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4443d3b800 from 13 10000000:01000000:1.0:1784935682.029011:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784935682.029074:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935682.029105:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935682.029116:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935682.029156:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292140416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935682.029229:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935682.029272:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454913fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784935682.029481:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292140416 00000100:00100000:3.0:1784935682.029489:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292140416 00000100:00100000:3.0:1784935682.029550:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784935682.029560:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+16:17194:x1871640292140416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935682.029573:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935682.029587:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b1787f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17878 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935682.029610:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b1787f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17878 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935682.029619:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b1787f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17878 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935682.029628:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020e00, rc 0) 00000100:00100000:3.0:1784935682.029680:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17194:x1871640292140416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935682.029687:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784935682.029756:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292140416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935682.029771:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935682.029780:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935682.029843:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292140544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935682.029878:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935682.029893:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f9d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935682.029909:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292140544 00000100:00100000:1.0:1784935682.029913:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292140544 00000100:00100000:1.0:1784935682.029966:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784935682.029973:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17194:x1871640292140544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935682.030091:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17194:x1871640292140544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935682.030099:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784935682.031421:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292140544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935682.031487:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292140672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935682.031549:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935682.031593:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f9d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935682.032274:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292140672 00000100:00100000:1.0:1784935682.032282:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292140672 00000100:00100000:1.0:1784935682.032329:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784935682.032338:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17194:x1871640292140672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935682.032482:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17194:x1871640292140672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935682.032490:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784935682.033981:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292140672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784935682.036680:0:18411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784935682.037607:0:17194:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784935682.037635:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784935682.037646:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935682.037659:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935682.037670:0:17194:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784935682.037672:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4443cc0000 from 13 10000000:01000000:2.0:1784935682.037676:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784935682.037711:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935682.037719:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935682.037729:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935682.037752:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292140800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784935682.038223:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935682.038311:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4560e7a840 going to sleep for 11 seconds 00000100:00100000:3.0:1784935682.038370:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292140800 00000100:00100000:3.0:1784935682.038378:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292140800 00000100:00100000:2.0:1784935682.038702:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784935682.038711:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+17:17194:x1871640292140800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784935682.038733:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935682.038748:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1788d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17886 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935682.038771:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1788d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17886 expref: 18 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935682.038781:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1788d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17886 expref: 18 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935682.038791:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443200c00, rc 0) 00000100:00100000:2.0:1784935682.038844:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17194:x1871640292140800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935682.038851:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784935682.038972:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292140800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935682.038988:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935682.038997:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935682.040014:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292140928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935682.040553:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935682.040588:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f9df00 going to sleep for 11 seconds 00000100:00100000:2.0:1784935682.040663:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292140928 00000100:00100000:2.0:1784935682.040672:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292140928 00000100:00100000:2.0:1784935682.040720:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784935682.040728:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17194:x1871640292140928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784935682.040855:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17194:x1871640292140928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935682.040862:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784935682.041294:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292140928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935682.041346:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292141056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935682.041393:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935682.041413:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f9df00 going to sleep for 11 seconds 00000100:00100000:3.0:1784935682.041687:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292141056 00000100:00100000:3.0:1784935682.041700:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292141056 00000100:00100000:3.0:1784935682.041736:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784935682.041743:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45705ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17194:x1871640292141056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784935682.041849:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45705ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:17194:x1871640292141056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935682.041857:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784935682.042602:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292141056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784935682.048290:0:18413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784935682.048487:0:17194:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784935682.048514:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784935682.048525:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935682.048533:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935682.349151:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935682.477240:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935672/real 1784935672] req@ffff8d4574030e00 x1871640292135168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935682 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935682.477270:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4574030e00 x1871640292135168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935682 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935682.477281:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935672/real 1784935672] req@ffff8d4443433100 x1871640292135040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935682 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935682.477303:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4443433100 x1871640292135040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935682 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784935682.477322:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935682.477438:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784935682.477450:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292135168:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1784935682.477457:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581e88000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935682.477462:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784935682.477465:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292135040:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1784935682.477714:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935682.477719:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935682.477722:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935682.477725:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935682.477752:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935682.477755:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784935682.477758:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d4581e88000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784935682.477763:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1784935682.477768:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784935682.477774:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d4581e88000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935682.477792:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574031180 x1871640292141568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784935682.477824:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935682.477827:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784935682.477829:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784935682.477832:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1784935682.477835:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784935682.477838:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d455126f800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935682.477851:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574031500 x1871640292141696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784935682.477886:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292141312:0@lo:400:kworker.0 00000100:00100000:3.0:1784935682.477971:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935682.478000:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935682.478006:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292141440:0@lo:400:kworker.0 00000100:00100000:3.0:1784935682.478031:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935682.478078:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292141440 00000100:00100000:3.0:1784935682.478084:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292141440 00000100:00100000:3.0:1784935682.478182:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784935682.478192:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292141440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935682.478241:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292141440:12345-0@lo:400:kworker.0 Request processed in 51us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935682.478249:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784935682.478286:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292141824:0@lo:400:kworker.0 00000100:00100000:3.0:1784935682.478287:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292141440:0@lo:400:kworker.0 00000100:00100000:1.0:1784935682.478325:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935682.478427:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935682.478434:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292141184:0@lo:400:kworker.0 00000100:00100000:1.0:1784935682.478469:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935682.478496:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292141184 00000100:00100000:1.0:1784935682.478500:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292141184 00000100:00100000:1.0:1784935682.478526:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784935682.478533:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292141184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935682.478569:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292141184:12345-0@lo:400:kworker.0 Request processed in 36us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935682.478575:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784935682.478601:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292141184:0@lo:400:kworker.0 00000100:00100000:3.0:1784935682.478785:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292141312 00000100:00100000:3.0:1784935682.478791:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292141312 00000100:00100000:2.0:1784935682.478808:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292141824 00000100:00100000:2.0:1784935682.478815:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292141824 00000100:00100000:3.0:1784935682.478830:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784935682.478840:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292141312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935682.478897:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292141312:12345-0@lo:400:kworker.0 Request processed in 59us (925us total) trans 0 rc 0/0 00010000:00080000:1.0:1784935682.478960:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4574030000 x1871640292141312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935682.478971:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292141312:0@lo:400:kworker.0 00000100:00100000:2.0:1784935682.482459:0:17197:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784935682.482474:0:17197:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1784935682.482482:0:17198:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1784935682.482496:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784935682.482508:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292141824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935682.482596:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292141824:12345-0@lo:400:kworker.0 Request processed in 91us (4271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935682.482604:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784935682.482648:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292141568:0@lo:8:kworker.0 00010000:00080000:1.0:1784935682.482650:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4574031880 x1871640292141824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935682.482663:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292141824:0@lo:400:kworker.0 00000400:00000100:2.0:1784935682.482680:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871640292141568 offset 0 length 520: 4 00000100:00100000:2.0:1784935682.482710:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292141696:0@lo:8:kworker.0 00000400:00000100:2.0:1784935682.482729:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871640292141696 offset 0 length 520: 4 00000100:00100000:3.0:1784935682.483069:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784935683.373334:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935683.501214:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292141952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784935683.501297:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935683.501368:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292141952 00000100:00100000:1.0:1784935683.501375:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292141952 00000100:00100000:1.0:1784935683.501445:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784935683.501454:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292141952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784935683.501487:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784935683.501535:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292141952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935683.501541:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784935683.501586:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292141952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784935683.505984:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784935683.508486:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292142080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935683.508557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935683.508716:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292142080 00000100:00100000:2.0:1784935683.508725:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292142080 00000100:00100000:2.0:1784935683.508777:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784935683.508785:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640292142080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784935683.508817:0:17938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784935683.508863:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640292142080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935683.508870:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784935683.509238:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292142080:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1784935683.509328:0:17930:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1784935684.398105:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935684.525096:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935669/real 1784935669] req@ffff8d4574032a00 x1871640292133248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935684 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935684.525127:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4574032a00 x1871640292133248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935684 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935684.525138:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935669/real 1784935669] req@ffff8d4574033480 x1871640292133376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935684 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935684.525151:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4574033480 x1871640292133376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935684 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784935684.525173:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581cd4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935684.525256:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784935684.525262:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292133248:0@lo:8:kworker.0 00000100:00080000:2.0:1784935684.525333:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4573e19000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935684.525340:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784935684.525343:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292133376:0@lo:8:kworker.0 00000100:00080000:2.0:1784935684.525421:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935684.525425:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784935684.525435:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d4581cd4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784935684.525440:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1784935684.525445:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784935684.525451:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d4581cd4000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935684.525471:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443cd7480 x1871640292142464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935684.525485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935684.525497:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784935684.525498:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d4573e19000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784935684.525502:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1784935684.525505:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784935684.525508:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d4573e19000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935684.525522:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443598e00 x1871640292142592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935684.525543:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935684.525546:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784935684.525675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935684.525678:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784935684.525704:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292142336:0@lo:400:kworker.0 00000100:00100000:2.0:1784935684.525899:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935684.525958:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935684.525964:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292142720:0@lo:400:kworker.0 00000100:00100000:2.0:1784935684.525987:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935684.526031:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292142336 00000100:00100000:2.0:1784935684.526037:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292142336 00000100:00100000:2.0:1784935684.526074:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784935684.526081:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292142336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935684.526129:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292142336:12345-0@lo:400:kworker.0 Request processed in 48us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935684.526136:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784935684.526156:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292142720 00000100:00100000:2.0:1784935684.526159:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292142720 00000100:00100000:2.0:1784935684.526365:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784935684.526373:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292142720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935684.526407:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292142720:12345-0@lo:400:kworker.0 Request processed in 35us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935684.526412:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784935684.526458:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4443599f80 x1871640292142720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935684.526470:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292142720:0@lo:400:kworker.0 00000100:00100000:2.0:1784935684.526479:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292142336:0@lo:400:kworker.0 00000100:00100000:2.0:1784935684.526501:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292142464:0@lo:8:kworker.0 00000400:00000100:2.0:1784935684.526525:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871640292142464 offset 0 length 520: 4 00000100:00100000:2.0:1784935684.526542:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292142592:0@lo:8:kworker.0 00000400:00000100:2.0:1784935684.526558:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871640292142592 offset 0 length 520: 4 00000100:00100000:0.0:1784935684.528969:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292142208:0@lo:400:kworker.0 00000100:00100000:0.0:1784935684.529028:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935684.529064:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292142976:0@lo:400:kworker.0 00000100:00100000:0.0:1784935684.529094:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935684.529118:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784935684.529125:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292142848:0@lo:400:kworker.0 00000100:00100000:0.0:1784935684.529148:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935684.529216:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292142208 00000100:00100000:0.0:1784935684.529223:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292142208 00000100:00100000:0.0:1784935684.529263:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784935684.529271:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45705ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:3652:x1871640292142208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935684.529317:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45705ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:3652:x1871640292142208:12345-0@lo:400:kworker.0 Request processed in 47us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935684.529324:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784935684.529359:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292142976 00000100:00100000:0.0:1784935684.529362:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292142976 00000100:00100000:0.0:1784935684.529388:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784935684.529395:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292142976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935684.532414:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292142848 00000100:00100000:1.0:1784935684.532439:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292142848 00000100:00100000:1.0:1784935684.532496:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784935684.532508:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292142848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935684.532545:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292142976:12345-0@lo:400:kworker.0 Request processed in 3147us (3447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935684.532556:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784935684.532595:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292142848:12345-0@lo:400:kworker.0 Request processed in 89us (3444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935684.532603:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784935684.532612:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292142848:0@lo:400:kworker.0 00000100:00100000:0.0:1784935684.532626:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292142208:0@lo:400:kworker.0 00010000:00080000:0.0:1784935684.532640:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d444359a680 x1871640292142976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935684.532658:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292142976:0@lo:400:kworker.0 00000040:00080000:1.0:1784935685.358493:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784935685.422841:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935686.445079:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784935686.704315:0:18699:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784935686.704320:0:18699:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1784935686.704322:0:18699:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1784935686.704502:0:18699:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d457d1b3800 00000020:01000004:1.0:1784935686.704517:0:18699:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1784935686.704598:0:18699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784935686.704613:0:18699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d4566f3b380) 00000020:00000080:1.0:1784935686.704629:0:18699:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784935686.770200:0:18699:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784935686.777899:0:18699:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1784935686.779016:0:18699:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784935686.780081:0:18699:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1784935686.780552:0:18699:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784935686.780897:0:18699:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784935686.781363:0:18699:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1784935686.783775:0:18699:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784935686.784023:0:18699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784935686.784036:0:18699:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784935686.784047:0:18699:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x857e02f4e0b1789b 00000020:01000004:2.0:1784935686.784053:0:18699:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1784935686.784082:0:18699:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.128@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784935686.784084:0:18699:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784935686.784090:0:18699:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784935686.784094:0:18699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784935686.784105:0:18699:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d45703319c0) 00000020:00000080:2.0:1784935686.784116:0:18699:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1784935686.785151:0:18699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935686.785286:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784935686.785292:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1784935686.795576:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1784935686.795593:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1784935686.796359:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1784935686.796367:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1784935686.798912:0:18699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784935686.801558:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1784935686.801568:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1784935686.802465:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1784935686.802473:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784935686.861839:0:18699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784935686.862501:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784935686.862509:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784935686.863838:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784935686.863850:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1784935686.865473:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784935686.865483:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1784935686.868269:0:18699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935686.868458:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1784935686.868464:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1784935686.875591:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1784935686.875607:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1784935686.982315:0:18699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784935686.983100:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1784935686.983108:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1784935686.985648:0:18699:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1784935686.985662:0:18699:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1784935686.986374:0:18699:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1784935686.986475:0:18699:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1784935686.986481:0:18699:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.128@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1784935687.020820:0:18699:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.128@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784935687.020861:0:18699:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.128@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1784935687.020866:0:18699:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784935687.020868:0:18699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784935687.020869:0:18699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935687.020870:0:18699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784935687.020872:0:18699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935687.020873:0:18699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935687.020874:0:18699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784935687.020876:0:18699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935687.020877:0:18699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784935687.020881:0:18699:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1784935687.020883:0:18699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784935687.020884:0:18699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784935687.020885:0:18699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935687.020886:0:18699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784935687.020887:0:18699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935687.020889:0:18699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935687.020890:0:18699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784935687.020891:0:18699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935687.020892:0:18699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784935687.020924:0:18699:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784935687.021315:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143104:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784935687.021382:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935687.021436:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4548eda540 going to sleep for 11 seconds 00000100:00100000:2.0:1784935687.021621:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292143104 00000100:00100000:2.0:1784935687.021628:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292143104 00000100:00100000:0.0:1784935687.021826:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784935687.021836:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45705af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:18699:x1871640292143104:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784935687.021864:0:17191:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784935687.021867:0:17191:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1784935687.021870:0:17191:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784935687.024142:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45705af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:18699:x1871640292143104:12345-0@lo:253:mount.lustre.0 Request processed in 2301us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935687.024155:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784935687.024313:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143104:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784935687.024338:0:18699:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784935687.024341:0:18699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784935687.024342:0:18699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784935687.024343:0:18699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784935687.024345:0:18699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784935687.024346:0:18699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784935687.024347:0:18699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784935687.024349:0:18699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784935687.024351:0:18699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784935687.024352:0:18699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784935687.024370:0:18699:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d457d1b3800 from lustre-OST0000 10000000:01000000:0.0:1784935687.024408:0:18699:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1784935687.024659:0:18699:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784935687.024669:0:18699:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d4581edb380 local copy 00010000:00010000:0.0:1784935687.024681:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935687.024898:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784935687.025040:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935687.025082:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4548eda000 going to sleep for 11 seconds 00000100:00100000:3.0:1784935687.025196:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292143232 00000100:00100000:3.0:1784935687.025203:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292143232 00000100:00100000:3.0:1784935687.025244:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784935687.025252:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:18699:x1871640292143232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784935687.025322:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:18699:x1871640292143232:12345-0@lo:501:mount.lustre.0 Request processed in 71us (282us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784935687.025330:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784935687.025420:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143232:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784935687.025436:0:18699:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784935687.025453:0:18699:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784935687.025459:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935687.025467:0:18699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935687.025487:0:18699:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d457d1b3800 10000000:01000000:0.0:1784935687.025497:0:18699:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784935687.025502:0:18699:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784935687.025505:0:18699:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784935687.025510:0:18699:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1784935687.025512:0:18699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784935687.025787:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443699200/0x857e02f4e0b178a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935687.025797:0:18699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443699200/0x857e02f4e0b178a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935687.025806:0:18699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443699200/0x857e02f4e0b178a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935687.025819:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784935687.025847:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935687.025867:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4548eda000 going to sleep for 11 seconds 00000100:00100000:1.0:1784935687.026000:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292143360 00000100:00100000:1.0:1784935687.026004:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292143360 00000100:00100000:1.0:1784935687.026038:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784935687.026048:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+18:18699:x1871640292143360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784935687.026058:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935687.026070:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d1b8200/0x857e02f4e0b178b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b178a9 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.026089:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b8200/0x857e02f4e0b178b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b178a9 expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.026098:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d1b8200/0x857e02f4e0b178b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b178a9 expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.026105:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8200, rc 0) 00000100:00100000:1.0:1784935687.026138:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:18699:x1871640292143360:12345-0@lo:101:mount.lustre.0 Request processed in 93us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935687.026154:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784935687.026238:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784935687.026252:0:18699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443699200/0x857e02f4e0b178a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b178b0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935687.026259:0:18699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443699200/0x857e02f4e0b178a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b178b0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784935687.027448:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1784935687.028878:0:18699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784935687.031128:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1784935687.031173:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1784935687.031189:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1784935687.031201:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1784935687.031239:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1784935687.031255:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1784935687.031278:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1784935687.031284:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1784935687.031376:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784935687.031462:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935687.031507:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4548eda780 going to sleep for 11 seconds 00000100:00100000:2.0:1784935687.031966:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292143488 00000100:00100000:2.0:1784935687.031974:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292143488 00000100:00100000:2.0:1784935687.032070:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784935687.032081:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:18699:x1871640292143488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935687.032218:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:18699:x1871640292143488:12345-0@lo:501:mount.lustre.0 Request processed in 139us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935687.032226:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784935687.032322:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784935687.032359:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784935687.032422:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935687.032852:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4548eda780 going to sleep for 11 seconds 00000100:00100000:1.0:1784935687.032952:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292143616 00000100:00100000:1.0:1784935687.032958:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292143616 00000100:00100000:1.0:1784935687.032983:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784935687.032989:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:18699:x1871640292143616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784935687.033670:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:18699:x1871640292143616:12345-0@lo:503:mount.lustre.0 Request processed in 678us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935687.033678:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784935687.034024:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784935687.034444:0:18699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784935687.034517:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784935687.034579:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935687.034606:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4548eda000 going to sleep for 11 seconds 00000100:00100000:1.0:1784935687.035142:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292143744 00000100:00100000:1.0:1784935687.035149:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292143744 00000100:00100000:1.0:1784935687.035181:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784935687.035188:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:18699:x1871640292143744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784935687.035668:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:18699:x1871640292143744:12345-0@lo:502:mount.lustre.0 Request processed in 479us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935687.035676:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784935687.036019:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784935687.036198:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1784935687.036228:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1784935687.036246:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1784935687.036259:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1784935687.036271:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1784935687.036286:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1784935687.036301:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1784935687.036312:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1784935687.036323:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1784935687.036335:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1784935687.036358:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1784935687.036401:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1784935687.036443:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784935687.036486:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935687.036511:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4548eda000 going to sleep for 11 seconds 00000100:00100000:1.0:1784935687.036639:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292143872 00000100:00100000:1.0:1784935687.036645:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292143872 00000100:00100000:1.0:1784935687.036672:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784935687.036679:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:18699:x1871640292143872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784935687.036960:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:18699:x1871640292143872:12345-0@lo:502:mount.lustre.0 Request processed in 281us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935687.036967:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784935687.037247:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292143872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784935687.037291:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1784935687.037299:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1784935687.038302:0:18716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784935687.038312:0:18716:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1784935687.038318:0:18716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935687.038320:0:18716:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1784935687.038332:0:18716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784935687.038353:0:18716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d4443330000) 00000020:00000080:1.0:1784935687.038377:0:18716:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784935687.038395:0:18716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784935687.038476:0:18716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457d1b3800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1784935687.038485:0:18716:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784935687.038493:0:18716:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x857e02f4e0b178be 00010000:00010000:1.0:1784935687.051032:0:18716:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1784935687.054958:0:18716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1784935687.059110:0:18716:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1784935687.067838:0:18716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1784935687.067849:0:18716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935687.067855:0:18716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935687.067858:0:18716:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1784935687.067861:0:18716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784935687.067863:0:18716:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1784935687.067864:0:18716:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784935687.067866:0:18716:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784935687.067867:0:18716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784935687.067869:0:18716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935687.067870:0:18716:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784935687.067872:0:18716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784935687.067875:0:18716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935687.067876:0:18716:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784935687.067878:0:18716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784935687.067880:0:18716:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784935687.067882:0:18716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935687.067884:0:18716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935687.067885:0:18716:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784935687.067887:0:18716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784935687.067889:0:18716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935687.067890:0:18716:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784935687.067892:0:18716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784935687.067915:0:18716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784935687.067922:0:18716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935687.067923:0:18716:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784935687.068105:0:18716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1784935687.068816:0:18699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1784935687.068848:0:18699:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784935687.068877:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443699200/0x857e02f4e0b178a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b178b0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935687.068889:0:18699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443699200/0x857e02f4e0b178a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b178b0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935687.068897:0:18699:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457d1b3800 from 1 10000000:01000000:2.0:1784935687.068900:0:18699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784935687.069305:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935687.069314:0:18699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935687.069326:0:18699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935687.069351:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784935687.069855:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.069897:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547e889c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935687.070056:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292144000 00000100:00100000:0.0:1784935687.070063:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292144000 00000100:00100000:3.0:1784935687.070200:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784935687.070212:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:18699:x1871640292144000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784935687.070226:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935687.070239:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554020200/0x857e02f4e0b178cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b178c5 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935687.070261:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554020200/0x857e02f4e0b178cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b178c5 expref: 20 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935687.070282:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554020200/0x857e02f4e0b178cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b178c5 expref: 20 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935687.070291:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020200, rc 0) 00000100:00100000:3.0:1784935687.070333:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:18699:x1871640292144000:12345-0@lo:101:mount.lustre.0 Request processed in 124us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935687.070339:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784935687.071039:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784935687.071054:0:18699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935687.071065:0:18699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784935687.074230:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1784935687.075375:0:18699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784935687.077594:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1784935687.077871:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1784935687.077896:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1784935687.077902:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1784935687.078267:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935687.078330:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.078365:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547e88cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935687.078709:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292144128 00000100:00100000:3.0:1784935687.078717:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292144128 00000100:00100000:3.0:1784935687.078839:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784935687.078850:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:18699:x1871640292144128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784935687.079000:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:18699:x1871640292144128:12345-0@lo:501:mount.lustre.0 Request processed in 153us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935687.079008:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784935687.079889:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935687.079958:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784935687.080009:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.080038:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547e88cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935687.080834:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292144256 00000100:00100000:0.0:1784935687.080843:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292144256 00000100:00100000:0.0:1784935687.080895:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784935687.080905:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:18699:x1871640292144256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784935687.081043:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:18699:x1871640292144256:12345-0@lo:503:mount.lustre.0 Request processed in 139us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935687.081051:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784935687.081261:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784935687.083369:0:18699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784935687.084331:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935687.085182:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.085222:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547e889c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935687.085296:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292144384 00000100:00100000:0.0:1784935687.085303:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292144384 00000100:00100000:0.0:1784935687.085355:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784935687.085364:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:18699:x1871640292144384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784935687.086891:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:18699:x1871640292144384:12345-0@lo:502:mount.lustre.0 Request processed in 1523us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935687.086903:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784935687.089541:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784935687.090005:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1784935687.090037:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1784935687.090054:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1784935687.090068:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1784935687.090082:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1784935687.090095:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1784935687.090123:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1784935687.090155:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1784935687.090170:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1784935687.090183:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1784935687.090197:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1784935687.090244:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935687.090313:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.090346:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547e889c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935687.090818:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292144512 00000100:00100000:3.0:1784935687.090825:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292144512 00000100:00100000:3.0:1784935687.090877:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784935687.090886:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:18699:x1871640292144512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784935687.091026:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:18699:x1871640292144512:12345-0@lo:502:mount.lustre.0 Request processed in 141us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935687.091034:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784935687.091216:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784935687.091264:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1784935687.091273:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1784935687.095281:0:18720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935687.095291:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935687.095293:0:18720:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784935687.095299:0:18720:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d457d1b3800 00000020:00000080:1.0:1784935687.095302:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935687.095308:0:18720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935687.095310:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935687.095312:0:18720:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784935687.095314:0:18720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935687.095316:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935687.095317:0:18720:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784935687.095320:0:18720:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d457d1b3800 00000020:00000080:1.0:1784935687.095322:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935687.095371:0:18720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935687.095374:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935687.095375:0:18720:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1784935687.095377:0:18720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935687.095380:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935687.095388:0:18720:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784935687.095392:0:18720:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d457d1b3800 00000020:00000080:1.0:1784935687.095394:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935687.095409:0:18720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935687.095419:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935687.095421:0:18720:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784935687.095423:0:18720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935687.095425:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935687.095432:0:18720:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1784935687.095436:0:18720:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d457d1b3800 00000020:00000080:1.0:1784935687.095438:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784935687.095459:0:18720:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935687.095461:0:18720:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935687.095462:0:18720:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1784935687.095465:0:18720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1784935687.095796:0:18699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1784935687.095825:0:18699:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784935687.095847:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935687.095859:0:18699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935687.095901:0:18699:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784935687.095904:0:18699:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d457d1b3800 10000000:01000000:2.0:1784935687.095907:0:18699:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d457d1b3800 10000000:01000000:2.0:1784935687.095910:0:18699:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784935687.095914:0:18699:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d457d1b3800 from 1 10000000:01000000:2.0:1784935687.095917:0:18699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784935687.095967:0:18699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443200600/0x857e02f4e0b178d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935687.095976:0:18699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443200600/0x857e02f4e0b178d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935687.095986:0:18699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443200600/0x857e02f4e0b178d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935687.096006:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784935687.096067:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.096096:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547e88cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935687.096217:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292144640 00000100:00100000:0.0:1784935687.096223:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292144640 00000100:00100000:0.0:1784935687.096265:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784935687.096273:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:18699:x1871640292144640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784935687.096285:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935687.096296:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443698e00/0x857e02f4e0b178da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b178d3 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935687.096316:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443698e00/0x857e02f4e0b178da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b178d3 expref: 21 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935687.096332:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443698e00/0x857e02f4e0b178da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b178d3 expref: 21 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935687.096340:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698e00, rc 0) 00000100:00100000:0.0:1784935687.096373:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292144640:12345-0@lo:101:mount.lustre.0 Request processed in 101us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935687.096390:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784935687.097844:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784935687.097864:0:18699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443200600/0x857e02f4e0b178d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b178da expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935687.097874:0:18699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443200600/0x857e02f4e0b178d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b178da expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784935687.100223:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1784935687.100500:0:18699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784935687.101035:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1784935687.101070:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1784935687.101084:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1784935687.101096:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1784935687.101108:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1784935687.101119:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1784935687.101129:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1784935687.101139:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1784935687.101151:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1784935687.101162:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1784935687.101174:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1784935687.101187:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1784935687.101197:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1784935687.101207:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1784935687.101217:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1784935687.101227:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1784935687.101241:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1784935687.101267:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1784935687.101282:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1784935687.101296:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1784935687.101320:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1784935687.101333:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1784935687.101345:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1784935687.101358:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1784935687.101372:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1784935687.101399:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1784935687.101426:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1784935687.101442:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1784935687.101454:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1784935687.101465:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1784935687.101476:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1784935687.101486:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1784935687.101499:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1784935687.101536:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1784935687.101554:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1784935687.101568:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1784935687.101581:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1784935687.101600:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1784935687.101606:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1784935687.101716:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935687.101790:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.101843:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292144768 00000100:00100000:2.0:1784935687.101850:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292144768 00000100:00100000:2.0:1784935687.101895:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784935687.101903:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292144768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935687.102022:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292144768:12345-0@lo:501:mount.lustre.0 Request processed in 119us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935687.102029:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784935687.102070:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547e88d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784935687.102091:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935687.102126:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784935687.102162:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.102183:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292144896 00000100:00100000:2.0:1784935687.102187:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292144896 00000100:00100000:2.0:1784935687.102209:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784935687.102216:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292144896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784935687.102281:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292144896:12345-0@lo:503:mount.lustre.0 Request processed in 65us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935687.102288:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784935687.102321:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547e88d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784935687.102333:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292144896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784935687.102691:0:18699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784935687.102742:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292145024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935687.102778:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.102802:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292145024 00000100:00100000:2.0:1784935687.102806:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292145024 00000100:00100000:2.0:1784935687.102830:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784935687.102837:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292145024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935687.102899:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292145024:12345-0@lo:502:mount.lustre.0 Request processed in 62us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935687.102905:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784935687.102956:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549464240 going to sleep for 11 seconds 00000100:00100000:2.0:1784935687.102969:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292145024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784935687.103109:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1784935687.103132:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1784935687.103155:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1784935687.103170:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1784935687.103185:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1784935687.103198:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1784935687.103212:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1784935687.103223:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1784935687.103235:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1784935687.103263:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1784935687.103277:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1784935687.103290:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1784935687.103304:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1784935687.103316:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1784935687.103326:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1784935687.103338:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1784935687.103353:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1784935687.103367:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1784935687.103381:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1784935687.103394:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1784935687.103407:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1784935687.103438:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1784935687.103459:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1784935687.103471:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1784935687.103484:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1784935687.103509:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1784935687.103524:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1784935687.103537:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1784935687.103551:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1784935687.103564:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1784935687.103576:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1784935687.103589:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1784935687.103602:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1784935687.103613:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1784935687.103623:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1784935687.103644:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1784935687.103657:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1784935687.103670:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1784935687.103682:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1784935687.103694:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1784935687.103708:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1784935687.103732:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1784935687.103748:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1784935687.103761:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1784935687.103774:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1784935687.103786:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1784935687.103797:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1784935687.103810:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1784935687.103844:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292145152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935687.103884:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.103917:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292145152 00000100:00100000:2.0:1784935687.103922:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292145152 00000100:00100000:2.0:1784935687.103967:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784935687.103973:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292145152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935687.104048:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292145152:12345-0@lo:502:mount.lustre.0 Request processed in 74us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935687.104056:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784935687.104097:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547e88cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935687.104111:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292145152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784935687.104237:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1784935687.104257:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1784935687.104275:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292145280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935687.104308:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.104336:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292145280 00000100:00100000:2.0:1784935687.104340:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292145280 00000100:00100000:2.0:1784935687.104361:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784935687.104367:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292145280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784935687.105055:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549464240 going to sleep for 11 seconds 00000100:00100000:2.0:1784935687.107883:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292145280:12345-0@lo:502:mount.lustre.0 Request processed in 3507us (3566us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935687.107897:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784935687.107982:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292145280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784935687.108070:0:18699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1784935687.108084:0:18699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1784935687.109921:0:18722:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784935687.110092:0:18722:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d44434c99c0) 00000020:00000080:3.0:1784935687.110119:0:18722:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1784935687.110389:0:18722:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457d1b3800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784935687.110394:0:18722:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d457d1b3800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784935687.110397:0:18722:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457d1b3800 3 00010000:00080000:3.0:1784935687.110436:0:18722:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d45757de800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.128@tcp at head 00010000:00010000:3.0:1784935687.117893:0:18722:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1784935687.118027:0:18722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784935687.118070:0:18722:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784935687.118083:0:18722:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x857e02f4e0b178e8 00000100:00080000:3.0:1784935687.118093:0:18722:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784935687.118099:0:18722:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d45757de800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935687.118133:0:18722:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574032d80 x1871640292145408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784935687.118166:0:18722:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784935687.118216:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935687.118220:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935687.118223:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935687.118226:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935687.118249:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935687.118253:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935687.118255:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935687.118258:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784935687.118287:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292145792:0@lo:400:kworker.0 00000100:00100000:3.0:1784935687.118356:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935687.118402:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935687.118409:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292145920:0@lo:400:kworker.0 00000100:00100000:3.0:1784935687.118447:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.118881:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1871640292145408:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784935687.118913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.118974:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292145536:0@lo:400:kworker.0 00000100:00100000:2.0:1784935687.118999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.119017:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935687.119023:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292145664:0@lo:400:kworker.0 00000100:00100000:2.0:1784935687.119044:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935687.119080:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292145792 00000100:00100000:2.0:1784935687.119086:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292145792 00000100:00100000:2.0:1784935687.119118:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292145536 00000100:00100000:2.0:1784935687.119121:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292145536 00000100:00100000:2.0:1784935687.119137:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784935687.119144:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292145792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935687.119197:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292145792:12345-0@lo:400:kworker.0 Request processed in 52us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935687.119204:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784935687.119218:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784935687.119224:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292145536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935687.119256:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292145536:12345-0@lo:400:kworker.0 Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935687.119267:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784935687.119286:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292145920 00000100:00100000:2.0:1784935687.119289:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292145920 00000100:00100000:2.0:1784935687.119311:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292145408 00000100:00100000:2.0:1784935687.119314:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292145408 00000100:00100000:2.0:1784935687.119321:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292145664 00000100:00100000:2.0:1784935687.119323:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292145664 00000100:00100000:2.0:1784935687.119335:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935687.119340:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292145920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935687.119369:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292145920:12345-0@lo:400:kworker.0 Request processed in 28us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935687.119374:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935687.119670:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784935687.119680:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292145664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935687.119831:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292145664:12345-0@lo:400:kworker.0 Request processed in 153us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935687.119838:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784935687.119851:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784935687.119855:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1871640292145408:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784935687.119874:0:17198:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1784935687.119918:0:17198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x857e02f4e0b178ef 00000004:00100000:2.0:1784935687.119949:0:17198:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784935687.119977:0:17198:0:(import.c:65:import_set_state_nolock()) ffff8d4581ebd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784935687.120016:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871640292145408:12345-0@lo:38:llog_process_th.0 Request processed in 159us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935687.120022:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784935687.120177:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4574031880 x1871640292145920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935687.120191:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292145920:0@lo:400:kworker.0 00000100:00100000:2.0:1784935687.120204:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292145792:0@lo:400:kworker.0 00010000:00080000:2.0:1784935687.120233:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4574033480 x1871640292145664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935687.120242:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292145664:0@lo:400:kworker.0 00000100:00100000:2.0:1784935687.120250:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292145536:0@lo:400:kworker.0 00010000:00080000:2.0:1784935687.120273:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4574032d80 x1871640292145408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935687.120281:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784935687.120287:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1784935687.120293:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784935687.120297:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784935687.120300:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d45757de800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784935687.120304:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1871640292145408:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1784935687.122814:0:18722:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784935687.122831:0:18722:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d44434ccd40) 00000020:00000080:3.0:1784935687.122855:0:18722:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1784935687.123088:0:18722:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457d1b3800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784935687.123093:0:18722:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d457d1b3800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784935687.123096:0:18722:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457d1b3800 3 00010000:00080000:3.0:1784935687.123123:0:18722:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d45757dd800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.128@tcp at head 00010000:00010000:3.0:1784935687.129056:0:18722:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1784935687.129245:0:18722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1784935687.129295:0:18722:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784935687.129309:0:18722:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x857e02f4e0b178fd 00000100:00080000:3.0:1784935687.129319:0:18722:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784935687.129325:0:18722:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d45757dd800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935687.129362:0:18722:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574030e00 x1871640292146048/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784935687.129431:0:18722:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784935687.129573:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935687.129578:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935687.129581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935687.129584:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935687.129587:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935687.129590:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935687.129600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935687.129603:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784935687.129996:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1871640292146048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784935687.130068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935687.130127:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292146048 00000100:00100000:1.0:1784935687.130134:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292146048 00000100:00100000:1.0:1784935687.130166:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784935687.130173:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1871640292146048:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784935687.130201:0:17198:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:1.0:1784935687.130247:0:17198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x857e02f4e0b17904 00000004:00100000:1.0:1784935687.130262:0:17198:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784935687.130293:0:17198:0:(import.c:65:import_set_state_nolock()) ffff8d457d2a0800 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1784935687.130307:0:18722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:1.0:1784935687.130349:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871640292146048:12345-0@lo:38:llog_process_th.0 Request processed in 174us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935687.130358:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:3.0:1784935687.130396:0:18699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784935687.130436:0:18699:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784935687.130479:0:18699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443200600/0x857e02f4e0b178d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b178da expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1784935687.130494:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d4574030e00 x1871640292146048/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935687.130504:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784935687.130511:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1784935687.130517:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784935687.130533:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784935687.130535:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d45757dd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784935687.130542:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1871640292146048:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1784935687.130604:0:18699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443200600/0x857e02f4e0b178d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b178da expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784935687.130651:0:18699:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784935687.130653:0:18699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784935687.130654:0:18699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784935687.130656:0:18699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784935687.130657:0:18699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784935687.130658:0:18699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784935687.130660:0:18699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784935687.130662:0:18699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784935687.130663:0:18699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784935687.130668:0:18699:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1784935687.130671:0:18699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784935687.130672:0:18699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784935687.130673:0:18699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784935687.130675:0:18699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784935687.130676:0:18699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784935687.130677:0:18699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784935687.130679:0:18699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784935687.130680:0:18699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784935687.130681:0:18699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784935687.130698:0:18699:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784935687.130712:0:18699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292146176:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784935687.130752:0:18699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935687.130782:0:18699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4442062d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784935687.131347:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292146176 00000100:00100000:3.0:1784935687.131353:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292146176 00000100:00100000:3.0:1784935687.131386:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784935687.131393:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292146176:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784935687.131432:0:17190:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784935687.131443:0:17190:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784935687.133499:0:17190:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784935687.133513:0:17190:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784935687.133980:0:17213:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784935687.133985:0:17213:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784935687.134004:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.134021:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4554021c00/0x857e02f4e0b17855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1784e expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.134029:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b1785c expref: 21 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.134037:0:17213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.134072:0:17213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b1785c expref: 21 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.134088:0:17213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17863 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b1785c expref: 21 pid: 17191 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935687.134102:0:17213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dad500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292146304:0@lo:104: 00000100:00100000:1.0:1784935687.134159:0:17213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784935687.134202:0:17213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4554021c00/0x857e02f4e0b17855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b1784e expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.134211:0:17213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4554021c00/0x857e02f4e0b17855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b1784e expref: 21 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935687.134220:0:17213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292146432:0@lo:104: 00000100:00100000:1.0:1784935687.134244:0:17213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935687.134273:0:17213:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d44421fc900 going to sleep for 11 seconds 00000100:00100000:1.0:1784935687.134298:0:17181:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784935687.134313:0:17181:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292146304 00000100:00100000:1.0:1784935687.134320:0:17181:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292146304 00000100:00100000:1.0:1784935687.134349:0:17181:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292146432 00000100:00100000:1.0:1784935687.134352:0:17181:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292146432 00000100:00100000:1.0:1784935687.134366:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784935687.134373:0:17181:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+4:17213:x1871640292146304:12345-0@lo:104: 00010000:00010000:1.0:1784935687.134456:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.134508:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784935687.134514:0:17181:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+4:17213:x1871640292146304:12345-0@lo:104: Request processed in 142us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935687.134533:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784935687.134551:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784935687.134557:0:17181:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457d665850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:17213:x1871640292146432:12345-0@lo:104: 00010000:00010000:1.0:1784935687.134565:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.134597:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784935687.134602:0:17181:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457d665850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:17213:x1871640292146432:12345-0@lo:104: Request processed in 46us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935687.134833:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:18699:x1871640292146176:12345-0@lo:253:mount.lustre.0 Request processed in 3439us (4079us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935687.134842:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784935687.134888:0:18699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:18699:1871640292146176:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784935687.134911:0:18699:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784935687.134914:0:18699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784935687.134916:0:18699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784935687.134918:0:18699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784935687.134919:0:18699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784935687.134921:0:18699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784935687.134922:0:18699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784935687.134923:0:18699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784935687.134939:0:18699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784935687.134941:0:18699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784935687.134957:0:18699:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1784935687.135579:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1784935687.136162:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784935687.136171:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.136180:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200200 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935687.136196:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.136205:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935687.136212:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935687.136217:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784935687.136251:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.136257:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935687.136279:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.136286:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4443200200/0x857e02f4e0b1785c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17863 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.136299:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784935687.136302:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.136307:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:1.0:1784935687.136310:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.136316:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784935687.136333:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935687.136337:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784935687.136351:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.136357:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784935687.136363:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.136369:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4443201800/0x857e02f4e0b1784e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17855 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.138554:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935687.138562:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935687.138564:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935687.138572:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935687.138593:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292146560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935687.138672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935687.139150:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935687.139160:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292146688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935687.139187:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935687.139243:0:17183:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292146560 00000100:00100000:1.0:1784935687.139251:0:17183:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292146560 00010000:00010000:1.0:1784935687.139279:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17863 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1785c expref: 21 pid: 17191 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935687.139304:0:17183:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292146688 00000100:00100000:1.0:1784935687.139315:0:17183:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292146688 00010000:00010000:1.0:1784935687.139328:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4554021c00/0x857e02f4e0b17855 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1784e expref: 22 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935687.139343:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784935687.139350:0:17183:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:3649:x1871640292146560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784935687.139361:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935687.139366:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17863 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1785c expref: 22 pid: 17191 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139377:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17863 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b1785c expref: 22 pid: 17191 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139406:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935687.139447:0:17183:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:3649:x1871640292146560:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935687.139453:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784935687.139467:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784935687.139473:0:17183:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45705afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:3649:x1871640292146688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784935687.139480:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935687.139484:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4554021c00/0x857e02f4e0b17855 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b1784e expref: 21 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139493:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4554021c00/0x857e02f4e0b17855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b1784e expref: 21 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139505:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139513:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784935687.139533:0:17183:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007222081s 00010000:00010000:1.0:1784935687.139538:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139545:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139551:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139558:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139564:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8400 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935687.139568:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139575:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139584:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.139595:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935687.139630:0:17183:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45705afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:3649:x1871640292146688:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935687.139637:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1784935687.139716:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b1785c expref: 20 pid: 17191 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935687.141104:0:17213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dad500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292146304:0@lo:104: 00010000:00010000:1.0:1784935687.141130:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554021c00/0x857e02f4e0b17855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b1784e expref: 19 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935687.141138:0:17213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292146432:0@lo:104: 00010000:00010000:1.0:1784935687.141157:0:17213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.141167:0:17213:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.141173:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935687.141180:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b1790b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935687.141209:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292146688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935687.141218:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292146560:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1784935687.145847:0:18699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1784935687.156540:0:18699:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1784935687.156549:0:18699:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1784935687.156582:0:18699:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784935687.156843:0:18699:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.128@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784935687.156862:0:18699:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1784935687.156880:0:18699:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1784935687.158017:0:18699:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784935687.158221:0:18699:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784935687.475871:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784935688.078141:0:18779:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784935688.078360:0:18779:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784935688.500678:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935688.621603:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292146816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784935688.621674:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935688.621845:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292146816 00000100:00100000:0.0:1784935688.621853:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292146816 00000100:00100000:0.0:1784935688.621970:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784935688.621980:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292146816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935688.622011:0:17938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784935688.635235:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292146816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 13246us (13551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935688.635250:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784935688.639782:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292146816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784935688.639814:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935688.639826:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292146944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784935688.639890:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935688.640022:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292146944 00000100:00100000:2.0:1784935688.640030:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292146944 00000100:00100000:2.0:1784935688.640185:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784935688.640205:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292146944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784935688.640237:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784935688.640284:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292146944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935688.640291:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784935688.640724:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292146944:0@lo:41:osp-pre-0-1.0 10000000:01000000:1.0:1784935688.751251:0:17194:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784935688.751258:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4443d3b800 from 9 10000000:01000000:1.0:1784935688.751264:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784935688.751306:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935688.751318:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935688.751338:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935688.751364:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292147072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935688.751574:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935688.751619:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549153180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935688.753309:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292147072 00000100:00100000:0.0:1784935688.753319:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292147072 00000100:00100000:0.0:1784935688.753384:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784935688.753394:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+19:17194:x1871640292147072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935688.753420:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935688.753437:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b17919 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17912 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935688.753463:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b17919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17912 expref: 20 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935688.753475:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b17919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17912 expref: 20 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935688.753492:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699a00, rc 0) 00000100:00100000:0.0:1784935688.753562:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:17194:x1871640292147072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935688.753570:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784935688.753838:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292147072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935688.753856:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935688.753865:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935688.753922:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292147200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784935688.755959:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935688.756023:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549153180 going to sleep for 11 seconds 00000100:00100000:3.0:1784935688.756552:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292147200 00000100:00100000:3.0:1784935688.756561:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292147200 00000100:00100000:3.0:1784935688.756763:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784935688.756774:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:17194:x1871640292147200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784935688.756798:0:17190:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784935688.756819:0:17190:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784935688.756822:0:17190:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1784935688.758516:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292147200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784935688.758590:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784935688.758600:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935688.758610:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935688.758620:0:17194:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784935688.758622:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4443cc0000 from 9 10000000:01000000:1.0:1784935688.758630:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784935688.758660:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935688.758668:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935688.758679:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935688.758699:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292147328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935688.759222:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935688.759261:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549153180 going to sleep for 11 seconds 00000100:00100000:1.0:1784935688.759281:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292147328 00000100:00100000:1.0:1784935688.759287:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292147328 00000100:00100000:1.0:1784935688.759321:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784935688.759329:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:17194:x1871640292147328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935688.759342:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935688.759355:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d1b8e00/0x857e02f4e0b17927 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17920 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935688.760201:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b8e00/0x857e02f4e0b17927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17920 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935688.760217:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d1b8e00/0x857e02f4e0b17927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17920 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935688.760225:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8e00, rc 0) 00000100:00100000:1.0:1784935688.760282:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:17194:x1871640292147328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 953us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935688.760302:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784935688.760358:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292147328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784935688.761382:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:17194:x1871640292147200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (2942us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935688.761393:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1784935688.761680:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935688.761692:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935688.761775:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292147456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784935688.761829:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935688.761871:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549153180 going to sleep for 11 seconds 00000100:00100000:1.0:1784935688.761889:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292147456 00000100:00100000:1.0:1784935688.761895:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292147456 00000100:00100000:1.0:1784935688.761956:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784935688.761965:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:17194:x1871640292147456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784935688.761995:0:17191:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784935688.762012:0:17191:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784935688.762015:0:17191:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1784935688.770557:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:17194:x1871640292147456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 8585us (8719us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935688.770572:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784935688.770646:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292147456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784935688.770716:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784935688.770726:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935688.770747:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935689.517309:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935690.541129:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784935691.120397:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784935691.567148:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784935692.205444:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935692.205450:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784935692.205453:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935692.205456:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784935692.205480:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935692.205483:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784935692.205486:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935692.205489:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784935692.205529:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292147712:0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.205592:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935692.205634:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292148224:0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.205663:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935692.205687:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784935692.205693:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292147584:0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.205736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935692.205758:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292148096:0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.205779:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935692.205804:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292147840:0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.205843:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935692.205861:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292148352:0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.205882:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935692.205899:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935692.205905:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292147968:0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.205924:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935692.205979:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292147712 00000100:00100000:1.0:1784935692.205985:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292147712 00000100:00100000:1.0:1784935692.206024:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292147968 00000100:00100000:1.0:1784935692.206028:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292147968 00000100:00100000:1.0:1784935692.206044:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784935692.206051:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292147712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.206103:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292147712:12345-0@lo:400:kworker.0 Request processed in 52us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935692.206110:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784935692.206127:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784935692.206318:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292147968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.206357:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292147968:12345-0@lo:400:kworker.0 Request processed in 223us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935692.206363:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784935692.206394:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292147584 00000100:00100000:1.0:1784935692.206397:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292147584 00000100:00100000:1.0:1784935692.206422:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784935692.206428:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:3650:x1871640292147584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.206458:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:3650:x1871640292147584:12345-0@lo:400:kworker.0 Request processed in 31us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935692.206474:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784935692.206503:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292148224 00000100:00100000:1.0:1784935692.206507:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292148224 00000100:00100000:1.0:1784935692.206535:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292148096 00000100:00100000:1.0:1784935692.206538:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292148096 00000100:00100000:1.0:1784935692.206548:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292147840 00000100:00100000:1.0:1784935692.206550:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292147840 00000100:00100000:1.0:1784935692.206558:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292148352 00000100:00100000:1.0:1784935692.206560:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292148352 00000100:00100000:1.0:1784935692.206573:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784935692.206578:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292148224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.206607:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292148224:12345-0@lo:400:kworker.0 Request processed in 29us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935692.206613:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784935692.206624:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784935692.206629:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292148096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.206656:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292148096:12345-0@lo:400:kworker.0 Request processed in 27us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935692.206661:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784935692.206673:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784935692.206678:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292147840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.206702:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292147840:12345-0@lo:400:kworker.0 Request processed in 24us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935692.206719:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784935692.206731:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784935692.206737:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292148352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.206775:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292148352:12345-0@lo:400:kworker.0 Request processed in 40us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935692.206781:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1784935692.206819:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784935692.206823:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935692.206850:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292147968:0@lo:400:kworker.0 00010000:00080000:1.0:1784935692.206863:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443d0bb80 x1871640292147840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935692.206872:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292147840:0@lo:400:kworker.0 00010000:00080000:1.0:1784935692.206881:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443d08e00 x1871640292148352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935692.206889:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292148352:0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.206919:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292147584:0@lo:400:kworker.0 00010000:00080000:1.0:1784935692.206949:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443d0b100 x1871640292148096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935692.206958:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292148096:0@lo:400:kworker.0 00000100:00100000:1.0:1784935692.207072:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292147712:0@lo:400:kworker.0 00010000:00080000:1.0:1784935692.207088:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443d0ad80 x1871640292148224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935692.207096:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292148224:0@lo:400:kworker.0 00010000:00010000:2.0:1784935692.589230:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935693.613409:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935693.743204:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292148480:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784935693.743276:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935693.744577:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292148480 00000100:00100000:0.0:1784935693.744588:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292148480 00000100:00100000:0.0:1784935693.744646:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784935693.744657:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292148480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935693.744691:0:17938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784935693.744759:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292148480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935693.744767:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784935693.744877:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292148480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935693.745232:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935693.745245:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292148608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784935693.745282:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935693.745379:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292148608 00000100:00100000:1.0:1784935693.745384:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292148608 00000100:00100000:1.0:1784935693.745427:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784935693.745435:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292148608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784935693.745453:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784935693.745590:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292148608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935693.745597:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784935693.745655:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292148608:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1784935693.890469:0:19069:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784935694.637919:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784935694.757248:0:19121:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784935694.757497:0:19121:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1784935695.602830:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784935695.670505:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784935695.784270:0:19171:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784935695.784526:0:19171:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784935696.687000:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784935697.326911:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784935697.326920:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784935697.326923:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784935697.326962:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784935697.326984:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784935697.326987:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784935697.326990:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784935697.326994:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784935697.327081:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292148992:0@lo:400:kworker.0 00000100:00100000:0.0:1784935697.327179:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935697.327246:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292149504:0@lo:400:kworker.0 00000100:00100000:0.0:1784935697.327276:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935697.327303:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784935697.327310:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292148864:0@lo:400:kworker.0 00000100:00100000:0.0:1784935697.327338:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935697.327373:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292149376:0@lo:400:kworker.0 00000100:00100000:0.0:1784935697.327400:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935697.327738:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292148736:0@lo:400:kworker.0 00000100:00100000:2.0:1784935697.327784:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935697.327815:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292149248:0@lo:400:kworker.0 00000100:00100000:2.0:1784935697.327839:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935697.327862:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935697.327867:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292149120:0@lo:400:kworker.0 00000100:00100000:2.0:1784935697.327890:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935697.327961:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292148864 00000100:00100000:2.0:1784935697.327970:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292148864 00000100:00100000:2.0:1784935697.328029:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292149120 00000100:00100000:2.0:1784935697.328032:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292149120 00000100:00100000:2.0:1784935697.328049:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784935697.328059:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292148864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935697.328127:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292148864:12345-0@lo:400:kworker.0 Request processed in 68us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935697.328134:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784935697.328151:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784935697.328169:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292149120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935697.328201:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292149120:12345-0@lo:400:kworker.0 Request processed in 45us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935697.328207:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784935697.328231:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292148992 00000100:00100000:2.0:1784935697.328234:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292148992 00000100:00100000:2.0:1784935697.328265:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292149504 00000100:00100000:2.0:1784935697.328269:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292149504 00000100:00100000:2.0:1784935697.328291:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292149376 00000100:00100000:2.0:1784935697.328293:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292149376 00000100:00100000:2.0:1784935697.328306:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292149248 00000100:00100000:2.0:1784935697.328309:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292149248 00000100:00100000:2.0:1784935697.328321:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784935697.328327:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292148992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935697.328371:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292148992:12345-0@lo:400:kworker.0 Request processed in 44us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935697.328377:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784935697.328389:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784935697.328394:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292149504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935697.328422:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292149504:12345-0@lo:400:kworker.0 Request processed in 28us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935697.328428:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784935697.328438:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784935697.328443:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292149376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935697.328468:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292149376:12345-0@lo:400:kworker.0 Request processed in 25us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935697.328473:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784935697.328484:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784935697.328490:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292149248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935697.328516:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292149248:12345-0@lo:400:kworker.0 Request processed in 27us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935697.328522:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784935697.328564:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292149120:0@lo:400:kworker.0 00010000:00080000:2.0:1784935697.328588:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443433800 x1871640292149248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935697.328599:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292149248:0@lo:400:kworker.0 00000100:00100000:2.0:1784935697.328633:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292148864:0@lo:400:kworker.0 00010000:00080000:2.0:1784935697.328644:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443433b80 x1871640292149376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935697.328652:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292149376:0@lo:400:kworker.0 00010000:00080000:2.0:1784935697.328661:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443433480 x1871640292148992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935697.328670:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292148992:0@lo:400:kworker.0 00010000:00080000:2.0:1784935697.328684:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443432300 x1871640292149504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935697.328691:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292149504:0@lo:400:kworker.0 00000100:00080000:1.0:1784935697.329080:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935697.329087:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935697.329282:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292148736 00000100:00100000:0.0:1784935697.329289:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292148736 00000100:00100000:0.0:1784935697.329334:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784935697.329350:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:3650:x1871640292148736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935697.329413:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:3650:x1871640292148736:12345-0@lo:400:kworker.0 Request processed in 71us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935697.329420:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784935697.329640:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292148736:0@lo:400:kworker.0 00000100:00100000:1.0:1784935697.391109:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935682/real 1784935682] req@ffff8d4574031180 x1871640292141568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935697 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935697.391149:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4574031180 x1871640292141568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935697 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935697.391161:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935682/real 1784935682] req@ffff8d4574031500 x1871640292141696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935697 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935697.391173:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4574031500 x1871640292141696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935697 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784935697.391202:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581e88000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784935697.391237:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784935697.391242:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292141568:0@lo:8:kworker.0 00000100:00080000:1.0:1784935697.391248:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784935697.391253:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784935697.391256:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292141696:0@lo:8:kworker.0 00000100:00080000:3.0:1784935697.392032:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935697.392040:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935697.392044:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935697.392055:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935697.392060:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935697.392063:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784935697.392067:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d4581e88000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784935697.392074:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1784935697.392081:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784935697.392091:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d4581e88000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935697.392140:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574033100 x1871640292149632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784935697.392163:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935697.392167:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784935697.392168:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784935697.392172:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1784935697.392174:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784935697.392178:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d455126f800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935697.392190:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574031500 x1871640292149760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784935697.392496:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292149632:0@lo:8:kworker.0 00000100:00100000:1.0:1784935697.392591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935697.392654:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292149760:0@lo:8:kworker.0 00000100:00100000:1.0:1784935697.392685:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935697.392786:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292149632 00000100:00100000:2.0:1784935697.392797:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292149632 00000100:00100000:2.0:1784935697.392837:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292149760 00000100:00100000:2.0:1784935697.392841:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292149760 00000100:00100000:2.0:1784935697.392855:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784935697.392864:0:18703:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1871640292149632:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1784935697.392901:0:18703:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1784935697.392971:0:18703:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b1792e 00002000:00100000:2.0:1784935697.392990:0:18703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d4581eba000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1784935697.393016:0:18703:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1784935697.393020:0:18703:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784935697.393229:0:18703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1784935697.393259:0:18703:0:(import.c:65:import_set_state_nolock()) ffff8d4581ebf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784935697.393333:0:18703:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1871640292149632:12345-0@lo:8:kworker.0 Request processed in 468us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935697.393341:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784935697.393369:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935697.393374:0:18703:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1871640292149760:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784935697.393388:0:18703:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1784935697.396084:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574033100 x1871640292149632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784935717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935697.396103:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784935697.396115:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1784935697.396126:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784935697.396134:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784935697.396139:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581e88000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784935697.396171:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784935697.396178:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292149632:0@lo:8:kworker.0 00000004:00080000:1.0:1784935697.396216:0:17939:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784935697.396354:0:17939:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 516646425973ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784935697.396363:0:17939:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1784935697.396799:0:17940:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1784935697.396832:0:17940:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574005c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17940:1871640292150016:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1784935697.396947:0:17940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935697.396979:0:17940:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4572a59cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935697.396994:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935697.397020:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292149888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935697.397050:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935697.397094:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292149888 00000100:00100000:0.0:1784935697.397102:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292149888 00000100:00100000:0.0:1784935697.397161:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784935697.397170:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1871640292149888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784935697.397205:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784935697.397255:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1871640292149888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935697.397263:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784935697.397306:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574004e00 x1871640292149888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935697.397325:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292149888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935697.400167:0:18705:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784935697.400187:0:18705:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1784935697.400366:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935697.400394:0:18706:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1784935697.400410:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292150016 00000100:00100000:1.0:1784935697.400423:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292150016 00000100:00100000:0.0:1784935697.407764:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784935697.411225:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17940:x1871640292150016:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1784935697.424263:0:17930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1784935697.428980:0:19236:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1784935697.428993:0:19236:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1784935697.429152:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17940:x1871640292150016:12345-0@lo:7:osp-pre-0-1.0 Request processed in 17954us (32219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935697.429167:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935697.429694:0:18703:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1871640292149760:12345-0@lo:8:kworker.0 Request processed in 36316us (37006us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784935697.429705:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784935697.430165:0:17940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574005c00 x1871640292150016/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784935713 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935697.430185:0:17940:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574005c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17940:1871640292150016:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1784935697.430203:0:17940:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1784935697.430267:0:17940:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17940:1871640292150144:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1784935697.430401:0:17940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935697.430458:0:17940:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1efcc0 going to sleep for 11 seconds 00000100:00080000:1.0:1784935697.430497:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784935697.430504:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784935697.430507:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292149760:0@lo:8:kworker.0 00000100:00100000:2.0:1784935697.430623:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292150144 00000100:00100000:2.0:1784935697.430633:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292150144 00000100:00100000:2.0:1784935697.430700:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784935697.430712:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17940:x1871640292150144:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1784935697.430751:0:18706:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1784935697.430797:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17940:x1871640292150144:12345-0@lo:5:osp-pre-0-1.0 Request processed in 87us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935697.430804:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784935697.432454:0:17940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443d09880 x1871640292150144/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784935713 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935697.432474:0:17940:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17940:1871640292150144:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1784935697.432493:0:17940:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1784935697.432554:0:17940:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17940:1871640292150272:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1784935697.432623:0:17940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935697.432661:0:17940:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1efcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935697.432816:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292150272 00000100:00100000:3.0:1784935697.432846:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292150272 00000100:00100000:3.0:1784935697.432917:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784935697.432954:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17940:x1871640292150272:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1784935697.433089:0:19236:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1784935697.465831:0:18700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1784935697.465853:0:18700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1784935697.482629:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17940:x1871640292150272:12345-0@lo:5:osp-pre-0-1.0 Request processed in 49688us (49989us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1784935697.482647:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1784935697.490193:0:17940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443d09880 x1871640292150272/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784935713 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935697.490212:0:17940:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1784935697.490220:0:17940:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17940:1871640292150272:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1784935697.490241:0:17940:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1784935697.490331:0:17940:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574004e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17940:1871640292150400:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1784935697.490436:0:17940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935697.490482:0:17940:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4572a599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784935697.490690:0:17208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292150400 00000100:00100000:3.0:1784935697.490699:0:17208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292150400 00000100:00100000:3.0:1784935697.490758:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784935697.490768:0:17208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17940:x1871640292150400:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1784935697.490835:0:17208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17940:x1871640292150400:12345-0@lo:900:osp-pre-0-1.0 Request processed in 68us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935697.490843:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784935697.491141:0:17940:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574004e00 x1871640292150400/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784935713 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935697.491202:0:17940:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574004e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17940:1871640292150400:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1784935697.717951:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935698.733758:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935698.866552:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292150528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784935698.866656:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935698.866740:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292150528 00000100:00100000:3.0:1784935698.866749:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292150528 00000100:00100000:3.0:1784935698.866812:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784935698.866822:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292150528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784935698.866869:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784935698.866961:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292150528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935698.866970:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784935698.867027:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292150528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935698.890392:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292150656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935698.890491:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935698.890639:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292150656 00000100:00100000:0.0:1784935698.890649:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292150656 00000100:00100000:0.0:1784935698.890721:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784935698.890732:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292150656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935698.890779:0:17938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784935698.900320:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292150656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9564us (9803us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935698.900347:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784935698.905480:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292150656:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784935699.763806:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935700.787148:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784935701.357595:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784935701.810583:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784935702.445717:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1784935702.445717:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292150784:0@lo:400:kworker.0 00000100:00080000:3.0:1784935702.445725:0:15171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935702.445728:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935702.445731:0:15171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784935702.445752:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784935702.445755:0:15171:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784935702.445759:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784935702.445765:0:15171:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 516 00000100:00080000:3.0:1784935702.445771:0:15171:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784935702.445779:0:15171:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d455126f800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:3.0:1784935702.445804:0:15171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574032a00 x1871640292151424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784935702.445827:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935702.445856:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292151168:0@lo:400:kworker.0 00000100:00100000:1.0:1784935702.445892:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292151296:0@lo:400:kworker.0 00000100:00100000:3.0:1784935702.445893:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935702.445915:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292151808:0@lo:400:kworker.0 00000100:00100000:1.0:1784935702.445918:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935702.445962:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935702.445973:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292150784 00000100:00100000:1.0:1784935702.445982:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292150784 00000100:00100000:3.0:1784935702.445991:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292150912:0@lo:400:kworker.0 00000100:00100000:3.0:1784935702.446019:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935702.446035:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292151552:0@lo:400:kworker.0 00000100:00100000:1.0:1784935702.446040:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784935702.446049:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:3652:x1871640292150784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935702.446076:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935702.446097:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784935702.446098:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:3652:x1871640292150784:12345-0@lo:400:kworker.0 Request processed in 50us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935702.446102:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292151040:0@lo:400:kworker.0 00000100:00100000:1.0:1784935702.446106:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784935702.446129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935702.446959:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292151296 00000100:00100000:2.0:1784935702.446967:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292151296 00000100:00100000:2.0:1784935702.447036:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784935702.447044:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292151296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935702.447099:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292151296:12345-0@lo:400:kworker.0 Request processed in 57us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935702.447105:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784935702.447237:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784935702.447249:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292151936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935702.447288:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935702.447426:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292151936 00000100:00100000:0.0:1784935702.447431:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292151936 00000100:00100000:0.0:1784935702.447463:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784935702.447469:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292151936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784935702.447496:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784935702.447532:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292151936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935702.447539:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784935702.447591:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d444359b100 x1871640292151936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935702.447612:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292151936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935702.448911:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292151680:0@lo:400:kworker.0 00000100:00100000:3.0:1784935702.449010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784935702.449996:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574033480 x1871640292151296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935702.450044:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292151296:0@lo:400:kworker.0 00000100:00100000:1.0:1784935702.450063:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292150784:0@lo:400:kworker.0 00000100:00100000:3.0:1784935702.468342:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292151424:0@lo:8:kworker.0 00000100:00100000:3.0:1784935702.468443:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935702.468494:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292151168 00000100:00100000:3.0:1784935702.468503:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292151168 00000100:00100000:3.0:1784935702.468556:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292150912 00000100:00100000:3.0:1784935702.468560:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292150912 00000100:00100000:3.0:1784935702.468579:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784935702.468588:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292151168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935702.468659:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292151168:12345-0@lo:400:kworker.0 Request processed in 71us (22764us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935702.468668:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784935702.468686:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784935702.468692:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935702.468721:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292150912:12345-0@lo:400:kworker.0 Request processed in 30us (22702us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935702.468727:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784935702.468810:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292150912:0@lo:400:kworker.0 00000100:00100000:3.0:1784935702.473113:0:18705:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292151424 00000100:00100000:3.0:1784935702.473137:0:18705:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292151424 00000100:00100000:3.0:1784935702.473216:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784935702.473226:0:18705:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1871640292151424:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784935702.473259:0:18705:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784935702.479352:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292151808 00000100:00100000:1.0:1784935702.479374:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292151808 00000100:00100000:1.0:1784935702.479960:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292151552 00000100:00100000:1.0:1784935702.479965:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292151552 00000100:00100000:1.0:1784935702.479981:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292151040 00000100:00100000:1.0:1784935702.479984:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292151040 00000100:00100000:1.0:1784935702.479995:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292151680 00000100:00100000:1.0:1784935702.479997:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292151680 00000100:00100000:1.0:1784935702.480023:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784935702.480033:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292151808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935702.480150:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292151808:12345-0@lo:400:kworker.0 Request processed in 118us (34186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935702.480158:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784935702.480176:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784935702.480182:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292151552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935702.480221:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292151552:12345-0@lo:400:kworker.0 Request processed in 38us (34143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935702.480227:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784935702.480237:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784935702.480242:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292151040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935702.480270:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871640292151040:12345-0@lo:400:kworker.0 Request processed in 28us (34141us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935702.480277:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784935702.480322:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784935702.480329:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292151680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935702.480362:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871640292151680:12345-0@lo:400:kworker.0 Request processed in 34us (31353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935702.480368:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1784935702.480421:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574032d80 x1871640292151040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935702.480439:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871640292151040:0@lo:400:kworker.0 00010000:00080000:1.0:1784935702.480452:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574031500 x1871640292151680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935702.480460:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1871640292151680:0@lo:400:kworker.0 00010000:00080000:1.0:1784935702.480473:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574031880 x1871640292151552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935702.480481:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292151552:0@lo:400:kworker.0 00000100:00100000:0.0:1784935702.484679:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292151168:0@lo:400:kworker.0 00010000:00080000:0.0:1784935702.484707:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4574033100 x1871640292151808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935702.484720:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292151808:0@lo:400:kworker.0 00000100:00080000:1.0:1784935702.488057:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935702.488071:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784935702.488075:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935702.488679:0:18705:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1871640292151424:12345-0@lo:8:kworker.0 Request processed in 15447us (20230us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784935702.488696:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1784935702.488868:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784935702.488875:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784935702.488880:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292151424:0@lo:8:kworker.0 00010000:00010000:2.0:1784935702.829167:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935703.857258:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935703.983005:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935703.983038:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292152064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935703.983115:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935703.983385:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935703.983409:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292152192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784935703.983479:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935703.984290:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292152064 00000100:00100000:2.0:1784935703.984313:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292152064 00000100:00100000:2.0:1784935703.984384:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292152192 00000100:00100000:2.0:1784935703.984389:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292152192 00000100:00100000:2.0:1784935703.984419:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784935703.984436:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292152064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784935703.984486:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784935703.984638:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784935703.984654:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292152192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935703.984684:0:17938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784935703.984747:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292152192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935703.984765:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784935703.984854:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292152192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935703.986554:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292152064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2109us (3426us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935703.986568:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784935703.993327:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292152064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784935704.498158:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935684/real 1784935684] req@ffff8d4443cd7480 x1871640292142464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935704 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935704.498201:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4443cd7480 x1871640292142464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935704 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935704.498212:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784935684/real 1784935684] req@ffff8d4443598e00 x1871640292142592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935704 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935704.498224:0:3648:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d4443598e00 x1871640292142592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784935704 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784935704.498249:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581cd4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784935704.498268:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784935704.498273:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292142464:0@lo:8:kworker.0 00000100:00080000:3.0:1784935704.498279:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4573e19000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784935704.498284:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784935704.498287:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292142592:0@lo:8:kworker.0 00000100:00080000:2.0:1784935704.498805:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935704.498810:0:15171:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784935704.498814:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8d4581cd4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784935704.498821:0:15171:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1784935704.498829:0:15171:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784935704.498837:0:15171:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d4581cd4000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935704.498875:0:15171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443598a80 x1871640292152448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935704.498903:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935704.498907:0:15171:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784935704.498909:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8d4573e19000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784935704.498912:0:15171:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1784935704.498915:0:15171:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784935704.498919:0:15171:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d4573e19000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935704.498963:0:15171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443598e00 x1871640292152576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935704.498998:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935704.499002:0:15171:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784935704.499004:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784935704.499007:0:15171:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:2.0:1784935704.499010:0:15171:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784935704.499014:0:15171:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d455126f800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935704.499026:0:15171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d444359b480 x1871640292152960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784935704.499077:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292152832:0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.499160:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.499201:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935704.499208:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292153088:0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.499237:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.499464:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292152832 00000100:00100000:2.0:1784935704.499473:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292152832 00000100:00100000:2.0:1784935704.499539:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784935704.499557:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292152832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.499762:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292152832:12345-0@lo:400:kworker.0 Request processed in 207us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.499771:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784935704.499819:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d444359b100 x1871640292152832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784935720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935704.499834:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292152832:0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.500049:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292152448:0@lo:8:kworker.0 00000100:00100000:2.0:1784935704.500085:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.500119:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292152320:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.500159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.500326:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292152576:0@lo:8:kworker.0 00000100:00100000:2.0:1784935704.500362:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.500380:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292152960:0@lo:8:kworker.0 00000100:00100000:2.0:1784935704.500399:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.500424:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292152448 00000100:00100000:2.0:1784935704.500429:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292152448 00000100:00100000:2.0:1784935704.500447:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292152576 00000100:00100000:2.0:1784935704.500449:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292152576 00000100:00100000:2.0:1784935704.500455:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292152960 00000100:00100000:2.0:1784935704.500457:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292152960 00000100:00100000:2.0:1784935704.500466:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784935704.500471:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1871640292152448:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1784935704.500500:0:18706:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1784935704.500530:0:18706:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b17935 00002000:00100000:2.0:1784935704.500548:0:18706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d4581eb8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784935704.500553:0:18706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784935704.500562:0:18706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784935704.500673:0:18706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784935704.500702:0:18706:0:(import.c:65:import_set_state_nolock()) ffff8d4581ebd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784935704.500751:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1871640292152448:12345-0@lo:8:kworker.0 Request processed in 278us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.500758:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784935704.500772:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784935704.500776:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1871640292152576:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784935704.500789:0:18706:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784935704.500815:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1871640292152576:12345-0@lo:8:kworker.0 Request processed in 37us (453us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784935704.500820:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784935704.500831:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935704.500835:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1871640292152960:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784935704.500845:0:18706:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784935704.500880:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1871640292152960:12345-0@lo:8:kworker.0 Request processed in 43us (480us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784935704.500886:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1784935704.500917:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443598a80 x1871640292152448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784935729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935704.500943:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784935704.500952:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1784935704.501189:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784935704.501196:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784935704.501200:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4581cd4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784935704.501229:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784935704.501242:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292152448:0@lo:8:kworker.0 00000004:00080000:2.0:1784935704.501285:0:17221:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784935704.501369:0:17222:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1784935704.501393:0:17222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17222:1871640292153600:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784935704.501440:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.501462:0:17222:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581e3c300 going to sleep for 11 seconds 00000100:00100000:3.0:1784935704.501479:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292153472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935704.501507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1784935704.501546:0:17221:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 523751617461ns, next at 0ns, rc = 0 00000100:00100000:3.0:1784935704.501549:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292153600 00080000:00080000:2.0:1784935704.501554:0:17221:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1784935704.501555:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292153600 00000100:00100000:3.0:1784935704.501593:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784935704.501600:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17222:x1871640292153600:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784935704.502777:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292153472 00000100:00100000:3.0:1784935704.502790:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292153472 00000100:00100000:3.0:1784935704.502871:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784935704.502881:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1871640292153472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935704.502914:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784935704.503253:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1871640292153472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 373us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935704.503260:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784935704.503471:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d457402c380 x1871640292153472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784935704.503494:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292153472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784935704.503533:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4573e19000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784935704.503539:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784935704.503542:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292152576:0@lo:8:kworker.0 00000100:00080000:3.0:1784935704.503554:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784935704.503558:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784935704.503561:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292152960:0@lo:8:kworker.0 00002000:00080000:3.0:1784935704.507192:0:18706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1784935704.507208:0:18706:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1784935704.507215:0:18706:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:2.0:1784935704.508257:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292153088 00000100:00100000:2.0:1784935704.508272:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292153088 00000100:00100000:2.0:1784935704.508375:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784935704.508386:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292153088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.508513:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292153088:12345-0@lo:400:kworker.0 Request processed in 128us (9274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.508521:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784935704.508567:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292152704:0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.508617:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.508649:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292153344:0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.508675:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.508709:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292152704 00000100:00100000:2.0:1784935704.508713:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292152704 00000100:00100000:2.0:1784935704.508734:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292153344 00000100:00100000:2.0:1784935704.508737:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292153344 00000100:00100000:2.0:1784935704.508762:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784935704.508767:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292152704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.508804:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1871640292152704:12345-0@lo:400:kworker.0 Request processed in 36us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.508810:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784935704.508823:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784935704.508829:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292153344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.508857:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292153344:12345-0@lo:400:kworker.0 Request processed in 29us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.508899:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1784935704.508977:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d444359bb80 x1871640292152704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935704.508993:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1871640292152704:0@lo:400:kworker.0 00010000:00080000:2.0:1784935704.509004:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d444359a680 x1871640292153344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935704.509012:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292153344:0@lo:400:kworker.0 00000100:00080000:0.0:1784935704.510157:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935704.510168:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784935704.511055:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d444359ad80 x1871640292153088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935704.511083:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292153088:0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.512192:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292152320 00000100:00100000:2.0:1784935704.512206:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292152320 00000100:00100000:2.0:1784935704.512287:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784935704.512306:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:3651:x1871640292152320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.512424:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:3651:x1871640292152320:12345-0@lo:400:kworker.0 Request processed in 128us (12264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.512432:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784935704.514750:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292153216:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.515235:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.515322:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292153216 00000100:00100000:2.0:1784935704.515338:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292153216 00000100:00100000:1.0:1784935704.515405:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292152320:0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.515644:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784935704.515660:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292153216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935704.515752:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292153216:12345-0@lo:400:kworker.0 Request processed in 98us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.515760:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1784935704.515800:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784935704.517642:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d4443599f80 x1871640292153216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935704.517665:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292153216:0@lo:400:kworker.0 00002000:00010000:3.0:1784935704.526485:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784935704.526514:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1793c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.526535:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784935704.526541:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935704.526548:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1793c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.526569:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1793c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.527362:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1793c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.527379:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1793c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.527415:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784935704.528580:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.528595:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1793c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.528612:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.528617:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1793c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.528641:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1793c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.528672:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1793c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.528680:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b1793c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.528710:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.528712:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.528714:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784935704.529253:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784935704.529264:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b17943 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.529524:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784935704.529530:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935704.529538:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b17943 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.529554:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b17943 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.530023:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b17943 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.530036:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b17943 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.530070:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784935704.531783:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935704.531799:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b17943 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.531812:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021c00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935704.531817:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b17943 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.531828:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b17943 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.531856:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b17943 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.531865:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b17943 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.531900:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.531903:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.531905:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784935704.532108:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.532115:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b1794a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.532127:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.532131:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.532137:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b1794a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.532161:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b1794a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.532704:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b1794a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.532712:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b1794a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.532739:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784935704.533229:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.533236:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b1794a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.533245:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201400 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.533249:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b1794a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.533259:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b1794a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.533273:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b1794a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.533311:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b1794a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.533329:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.533331:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.533332:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784935704.536635:0:17178:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1784935704.537664:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784935704.537680:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb70661/0x857e02f4e0b17951 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.537703:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784935704.537708:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935704.537716:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000deb70661/0x857e02f4e0b17951 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.537867:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000deb70661/0x857e02f4e0b17951 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.537881:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb70661/0x857e02f4e0b17951 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.537892:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000deb70661/0x857e02f4e0b17951 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.537969:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784935704.539292:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784935704.539316:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df0f6e4/0x857e02f4e0b17958 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.539335:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784935704.539339:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935704.539346:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002df0f6e4/0x857e02f4e0b17958 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.539360:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002df0f6e4/0x857e02f4e0b17958 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.539371:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002df0f6e4/0x857e02f4e0b17958 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.539380:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002df0f6e4/0x857e02f4e0b17958 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.539403:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784935704.539432:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784935704.539456:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000deb70661/0x857e02f4e0b17951 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.539478:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.539484:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb70661/0x857e02f4e0b17951 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.539499:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb70661/0x857e02f4e0b17951 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.539522:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000deb70661/0x857e02f4e0b17951 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.539530:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000deb70661/0x857e02f4e0b17951 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.539557:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.539562:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002df0f6e4/0x857e02f4e0b17958 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.539579:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.539582:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002df0f6e4/0x857e02f4e0b17958 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.539590:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002df0f6e4/0x857e02f4e0b17958 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.539601:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002df0f6e4/0x857e02f4e0b17958 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.539607:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002df0f6e4/0x857e02f4e0b17958 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.539620:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.539621:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.539623:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784935704.540306:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784935704.540316:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f0c30ce/0x857e02f4e0b1795f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.540329:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784935704.540341:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935704.540348:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f0c30ce/0x857e02f4e0b1795f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.540360:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f0c30ce/0x857e02f4e0b1795f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.540369:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f0c30ce/0x857e02f4e0b1795f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.540376:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f0c30ce/0x857e02f4e0b1795f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.540394:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784935704.540943:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935704.540958:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f0c30ce/0x857e02f4e0b1795f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.540970:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528400 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935704.540974:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0c30ce/0x857e02f4e0b1795f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.540985:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0c30ce/0x857e02f4e0b1795f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.541001:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f0c30ce/0x857e02f4e0b1795f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.541009:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f0c30ce/0x857e02f4e0b1795f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.541039:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.541041:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.541043:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.541411:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784935704.541899:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.541908:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17966 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.541922:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.542111:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.542118:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17966 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.542133:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17966 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.542144:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17966 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.542153:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17966 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.542168:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935704.542808:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935704.542815:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17966 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.542824:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935704.542828:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17966 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.542838:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17966 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.542854:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17966 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.542873:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b00b8e4d/0x857e02f4e0b17966 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.542890:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935704.542892:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935704.542894:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784935704.544148:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.544160:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b1796d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.544185:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.544189:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.544196:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b1796d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.544208:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b1796d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.544218:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b1796d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.544225:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b1796d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.544242:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784935704.546317:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.546329:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b17974 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.546345:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.546349:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.546354:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b17974 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.546366:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b17974 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.546390:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b17974 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.546397:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b17974 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.546422:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784935704.546836:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784935704.546844:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b1796d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.546854:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.546858:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b1796d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.546877:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b1796d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.546895:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b1796d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.546903:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064e4eb91/0x857e02f4e0b1796d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.546920:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.546923:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b17974 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.546949:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.546952:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b17974 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.546959:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b17974 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.546969:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b17974 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.546976:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdb7e2f5/0x857e02f4e0b17974 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.547000:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.547002:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.547004:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935704.547773:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784935704.548145:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.548161:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078caae71/0x857e02f4e0b1797b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.548178:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.548183:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.548190:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078caae71/0x857e02f4e0b1797b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.548208:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078caae71/0x857e02f4e0b1797b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.548218:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078caae71/0x857e02f4e0b1797b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.548225:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078caae71/0x857e02f4e0b1797b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.548280:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784935704.548800:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.548809:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078caae71/0x857e02f4e0b1797b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.548830:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201800 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.548834:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078caae71/0x857e02f4e0b1797b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.548844:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078caae71/0x857e02f4e0b1797b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.548864:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078caae71/0x857e02f4e0b1797b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.548871:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078caae71/0x857e02f4e0b1797b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.548897:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.548899:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.548900:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784935704.549899:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.549912:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b17982 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.550103:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.550109:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.550116:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b17982 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.550130:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b17982 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.550142:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b17982 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.550151:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b17982 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.550216:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784935704.550745:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.550753:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020232586/0x857e02f4e0b17989 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.550763:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.550774:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.550779:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020232586/0x857e02f4e0b17989 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.550789:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020232586/0x857e02f4e0b17989 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.550800:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020232586/0x857e02f4e0b17989 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.550807:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020232586/0x857e02f4e0b17989 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.551087:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784935704.551097:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b17982 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.551120:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.551124:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b17982 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.551135:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b17982 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.551154:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b17982 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.551162:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018c0b02e/0x857e02f4e0b17982 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.551189:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.551193:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020232586/0x857e02f4e0b17989 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.551199:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200400 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.551202:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020232586/0x857e02f4e0b17989 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.551209:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020232586/0x857e02f4e0b17989 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.551218:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020232586/0x857e02f4e0b17989 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.551235:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.551237:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.551239:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.551389:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.551394:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020232586/0x857e02f4e0b17989 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.551855:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.551862:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009fbf018/0x857e02f4e0b17990 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.551874:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.551878:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.551883:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009fbf018/0x857e02f4e0b17990 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.551894:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009fbf018/0x857e02f4e0b17990 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.551910:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009fbf018/0x857e02f4e0b17990 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.551918:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009fbf018/0x857e02f4e0b17990 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.552156:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.552162:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009fbf018/0x857e02f4e0b17990 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.552171:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200a00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.552174:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009fbf018/0x857e02f4e0b17990 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.552183:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009fbf018/0x857e02f4e0b17990 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.552196:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009fbf018/0x857e02f4e0b17990 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.552206:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.552207:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.552209:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.552265:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.552277:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009fbf018/0x857e02f4e0b17990 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.552659:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.552666:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b17997 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.552675:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.552679:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.552683:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b17997 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.552692:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b17997 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.552700:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b17997 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.552718:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b17997 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.552802:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.552807:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b17997 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.552823:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201400 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.552827:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b17997 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.552841:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b17997 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.552852:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b17997 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.552861:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.552863:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.552865:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.553137:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.553144:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f68c5859/0x857e02f4e0b17997 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.553510:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.553516:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004307a2f8/0x857e02f4e0b1799e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.553526:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.553530:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.553535:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004307a2f8/0x857e02f4e0b1799e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.553545:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004307a2f8/0x857e02f4e0b1799e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.553555:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004307a2f8/0x857e02f4e0b1799e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.553563:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004307a2f8/0x857e02f4e0b1799e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.553661:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.553667:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004307a2f8/0x857e02f4e0b1799e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.553675:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.553679:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004307a2f8/0x857e02f4e0b1799e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.553688:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004307a2f8/0x857e02f4e0b1799e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.553701:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004307a2f8/0x857e02f4e0b1799e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.553710:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.553712:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.553714:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.553776:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.553781:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004307a2f8/0x857e02f4e0b1799e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.554361:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.554368:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056d46111/0x857e02f4e0b179a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.554379:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.554383:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.554388:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056d46111/0x857e02f4e0b179a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.554399:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056d46111/0x857e02f4e0b179a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.554408:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056d46111/0x857e02f4e0b179a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.554416:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056d46111/0x857e02f4e0b179a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.554505:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.554511:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056d46111/0x857e02f4e0b179a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.554521:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.554525:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056d46111/0x857e02f4e0b179a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.554533:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056d46111/0x857e02f4e0b179a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.554545:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056d46111/0x857e02f4e0b179a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.554554:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.554556:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.554557:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.554680:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.554686:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056d46111/0x857e02f4e0b179a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.555277:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.555285:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b179ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.555303:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.555307:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.555313:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b179ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.555324:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b179ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.555334:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b179ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.555342:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b179ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.556514:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.556528:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b179ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.556542:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.556546:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b179ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.556558:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b179ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.556665:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b179ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.556679:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.556681:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.556683:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.556799:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.556807:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ebd9655/0x857e02f4e0b179ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.557518:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.557527:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b179b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.557553:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.557557:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.557563:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b179b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.557575:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b179b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.557585:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b179b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.557602:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b179b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.558072:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.558081:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b179b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.558091:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021c00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.558095:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b179b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.558104:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b179b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.558121:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b179b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.558131:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.558132:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.558134:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.558238:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.558244:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efb98797/0x857e02f4e0b179b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.558799:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.558807:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5064821/0x857e02f4e0b179ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.558831:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.558835:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.558842:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5064821/0x857e02f4e0b179ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.558868:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5064821/0x857e02f4e0b179ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.558878:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5064821/0x857e02f4e0b179ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.558886:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5064821/0x857e02f4e0b179ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.559097:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.559104:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5064821/0x857e02f4e0b179ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.559125:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.559128:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5064821/0x857e02f4e0b179ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.559136:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5064821/0x857e02f4e0b179ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.559148:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5064821/0x857e02f4e0b179ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.559157:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.559159:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.559161:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.559218:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.559223:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5064821/0x857e02f4e0b179ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.559581:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784935704.559739:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.559746:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dd32f25/0x857e02f4e0b179c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.559756:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.559760:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.559764:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dd32f25/0x857e02f4e0b179c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.559774:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dd32f25/0x857e02f4e0b179c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.559794:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dd32f25/0x857e02f4e0b179c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.559802:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dd32f25/0x857e02f4e0b179c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.559917:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784935704.560495:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.560502:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b179c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.560513:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.560517:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.560521:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b179c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.560532:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b179c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.560541:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b179c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.560548:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b179c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.560723:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784935704.560732:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dd32f25/0x857e02f4e0b179c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.560740:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300c00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.560744:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd32f25/0x857e02f4e0b179c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.560754:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd32f25/0x857e02f4e0b179c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.560771:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dd32f25/0x857e02f4e0b179c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.560786:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dd32f25/0x857e02f4e0b179c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.560891:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.560896:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b179c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.560904:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.560908:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b179c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.560916:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b179c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.561054:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b179c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.561064:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.561067:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.561069:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.561161:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.561167:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b179c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.561623:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.561630:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab63c52/0x857e02f4e0b179cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.561641:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.561645:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.561651:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab63c52/0x857e02f4e0b179cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.561662:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab63c52/0x857e02f4e0b179cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.561671:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab63c52/0x857e02f4e0b179cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.561679:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab63c52/0x857e02f4e0b179cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.561759:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.561766:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eab63c52/0x857e02f4e0b179cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.561775:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300a00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.561786:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab63c52/0x857e02f4e0b179cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.561794:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab63c52/0x857e02f4e0b179cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.561809:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eab63c52/0x857e02f4e0b179cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.561884:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.561887:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.561891:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.562100:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.562107:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab63c52/0x857e02f4e0b179cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.562719:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.562726:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbfee3e/0x857e02f4e0b179d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.562738:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.562741:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.562747:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bbfee3e/0x857e02f4e0b179d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.562758:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bbfee3e/0x857e02f4e0b179d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.562767:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbfee3e/0x857e02f4e0b179d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.562776:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bbfee3e/0x857e02f4e0b179d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.562807:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.562813:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bbfee3e/0x857e02f4e0b179d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.562829:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301800 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.562833:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbfee3e/0x857e02f4e0b179d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.562842:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbfee3e/0x857e02f4e0b179d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.562855:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bbfee3e/0x857e02f4e0b179d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.562865:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.562874:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.562876:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.563166:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.563172:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bbfee3e/0x857e02f4e0b179d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.563564:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.563571:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ee92fd2/0x857e02f4e0b179dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.563657:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.563662:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.563667:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ee92fd2/0x857e02f4e0b179dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.563679:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ee92fd2/0x857e02f4e0b179dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.563689:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ee92fd2/0x857e02f4e0b179dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.563697:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ee92fd2/0x857e02f4e0b179dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.563725:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.563732:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ee92fd2/0x857e02f4e0b179dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.563740:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.563744:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ee92fd2/0x857e02f4e0b179dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.563753:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ee92fd2/0x857e02f4e0b179dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.563765:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ee92fd2/0x857e02f4e0b179dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.563773:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.563775:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.563777:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.563839:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.563844:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ee92fd2/0x857e02f4e0b179dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.564449:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.564457:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27ff0e0/0x857e02f4e0b179e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.564466:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.564470:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.564475:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a27ff0e0/0x857e02f4e0b179e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.564501:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a27ff0e0/0x857e02f4e0b179e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.564511:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27ff0e0/0x857e02f4e0b179e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.564519:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a27ff0e0/0x857e02f4e0b179e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.564583:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.564589:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a27ff0e0/0x857e02f4e0b179e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.564663:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301c00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.564667:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27ff0e0/0x857e02f4e0b179e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.564676:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27ff0e0/0x857e02f4e0b179e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.564697:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a27ff0e0/0x857e02f4e0b179e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.564706:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.564708:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.564710:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.564767:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.564772:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a27ff0e0/0x857e02f4e0b179e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.565319:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.565325:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebe93bf/0x857e02f4e0b179eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.565336:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.565340:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.565345:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ebe93bf/0x857e02f4e0b179eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.565356:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ebe93bf/0x857e02f4e0b179eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.565376:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebe93bf/0x857e02f4e0b179eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.565384:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ebe93bf/0x857e02f4e0b179eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.565470:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.565476:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ebe93bf/0x857e02f4e0b179eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.565485:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301a00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.565489:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebe93bf/0x857e02f4e0b179eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.565497:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebe93bf/0x857e02f4e0b179eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.565509:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ebe93bf/0x857e02f4e0b179eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.565519:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.565521:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.565522:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.565581:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.565586:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ebe93bf/0x857e02f4e0b179eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935704.566148:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935704.566156:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5865f1c/0x857e02f4e0b179f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.566166:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784935704.566170:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935704.566175:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5865f1c/0x857e02f4e0b179f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.566186:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5865f1c/0x857e02f4e0b179f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.566195:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5865f1c/0x857e02f4e0b179f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.566214:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5865f1c/0x857e02f4e0b179f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.566262:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.566278:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5865f1c/0x857e02f4e0b179f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.566308:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.566312:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5865f1c/0x857e02f4e0b179f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.566321:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5865f1c/0x857e02f4e0b179f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.566334:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5865f1c/0x857e02f4e0b179f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.566343:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.566344:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.566347:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935704.566427:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784935704.566432:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5865f1c/0x857e02f4e0b179f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1784935704.566485:0:18706:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:0.0:1784935704.566678:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935704.566723:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17222:x1871640292153600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 65116us (65274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.566736:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784935704.567527:0:17222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17222:1871640292153600:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784935704.567549:0:17222:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1784935704.567599:0:17222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17222:1871640292153728:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784935704.567650:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.567682:0:17222:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d1efc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784935704.567781:0:18705:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292153728 00000100:00100000:1.0:1784935704.567787:0:18705:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292153728 00000100:00100000:1.0:1784935704.567843:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784935704.567852:0:18705:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17222:x1871640292153728:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1784935704.567893:0:18705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:3.0:1784935704.579121:0:18700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1784935704.579171:0:18700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784935704.580912:0:18705:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17222:x1871640292153728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13053us (13254us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1784935704.580924:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784935704.581029:0:17222:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1784935704.581038:0:17222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17222:1871640292153728:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784935704.581051:0:17222:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:01000004:0.0:1784935704.644774:0:19517:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784935704.644778:0:19517:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1784935704.644780:0:19517:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1784935704.644907:0:19517:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d457b962800 00000020:01000004:0.0:1784935704.644988:0:19517:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1784935704.645004:0:19517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784935704.645018:0:19517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d45745cb380) 00000020:00000080:0.0:1784935704.645040:0:19517:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784935704.737316:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784935704.741732:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784935704.745093:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1784935704.746210:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1784935704.750985:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784935704.751459:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784935704.751847:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1784935704.766416:0:19517:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784935704.766654:0:19517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1784935704.766670:0:19517:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784935704.766682:0:19517:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x857e02f4e0b17a00 00000020:01000004:3.0:1784935704.766689:0:19517:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1784935704.766711:0:19517:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.128@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784935704.766715:0:19517:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784935704.766721:0:19517:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1784935704.766752:0:19517:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1784935704.766756:0:19517:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.128@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784935704.789316:0:19517:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.128@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784935704.789357:0:19517:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.128@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1784935704.789361:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784935704.789363:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784935704.789365:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784935704.789366:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784935704.789368:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784935704.789369:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784935704.789371:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784935704.789373:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784935704.789374:0:19517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784935704.789378:0:19517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1784935704.789380:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784935704.789381:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784935704.789383:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784935704.789384:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784935704.789385:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784935704.789386:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784935704.789387:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784935704.789388:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784935704.789390:0:19517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784935704.789423:0:19517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784935704.789443:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292153856:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784935704.789512:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.789557:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4572a593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935704.789741:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292153856 00000100:00100000:1.0:1784935704.789749:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292153856 00000100:00100000:1.0:1784935704.789814:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784935704.789823:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:19517:x1871640292153856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784935704.789862:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784935704.789866:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1784935704.789869:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784935704.790364:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:19517:x1871640292153856:12345-0@lo:253:mount.lustre.0 Request processed in 540us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.790373:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784935704.790549:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292153856:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784935704.790559:0:19517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784935704.790561:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784935704.790563:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784935704.790564:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784935704.790565:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784935704.790566:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784935704.790567:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784935704.790568:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784935704.790570:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784935704.790571:0:19517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784935704.790588:0:19517:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d457b962800 from lustre-OST0001 10000000:01000000:3.0:1784935704.790614:0:19517:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784935704.790617:0:19517:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784935704.790626:0:19517:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d4581edb380 local copy 00010000:00010000:3.0:1784935704.790636:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935704.790714:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292153984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784935704.790744:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.790782:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45465923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935704.790837:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292153984 00000100:00100000:0.0:1784935704.790842:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292153984 00000100:00100000:0.0:1784935704.790876:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784935704.790882:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:19517:x1871640292153984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784935704.790971:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:19517:x1871640292153984:12345-0@lo:501:mount.lustre.0 Request processed in 89us (226us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784935704.790986:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784935704.791140:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292153984:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784935704.791153:0:19517:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784935704.791169:0:19517:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784935704.791175:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.791183:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554020000/0x857e02f4e0b17656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b1765d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935704.791207:0:19517:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d457b962800 10000000:01000000:3.0:1784935704.791216:0:19517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784935704.791222:0:19517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784935704.791224:0:19517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784935704.791228:0:19517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784935704.791231:0:19517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784935704.791249:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528c00/0x857e02f4e0b17a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.791257:0:19517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4541528c00/0x857e02f4e0b17a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.791277:0:19517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4541528c00/0x857e02f4e0b17a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935704.791291:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784935704.791328:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.791351:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45465923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784935704.791492:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292154112 00000100:00100000:1.0:1784935704.791503:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292154112 00000100:00100000:1.0:1784935704.791535:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784935704.791542:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:19517:x1871640292154112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784935704.791551:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935704.791563:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d1b8000/0x857e02f4e0b17a0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17a07 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.791584:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b8000/0x857e02f4e0b17a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17a07 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.791594:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d1b8000/0x857e02f4e0b17a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17a07 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.791603:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8000, rc 0) 00000100:00100000:1.0:1784935704.791639:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:19517:x1871640292154112:12345-0@lo:101:mount.lustre.0 Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.791645:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784935704.791743:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784935704.791832:0:19517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4541528c00/0x857e02f4e0b17a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a0e expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.791843:0:19517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4541528c00/0x857e02f4e0b17a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17a0e expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784935704.803901:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1784935704.806044:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784935704.809875:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784935704.809973:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784935704.809993:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784935704.810008:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784935704.810022:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784935704.810036:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784935704.810073:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784935704.810080:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784935704.810190:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784935704.810256:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.810307:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45465920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935704.810528:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292154240 00000100:00100000:2.0:1784935704.810535:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292154240 00000100:00100000:2.0:1784935704.810578:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784935704.810587:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:19517:x1871640292154240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935704.810742:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:19517:x1871640292154240:12345-0@lo:501:mount.lustre.0 Request processed in 155us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.810750:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784935704.813324:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784935704.813384:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784935704.813452:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.813528:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45465920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935704.822980:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292154368 00000100:00100000:0.0:1784935704.822994:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292154368 00000100:00100000:0.0:1784935704.823056:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784935704.823066:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4561d1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:19517:x1871640292154368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784935704.829218:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4561d1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:19517:x1871640292154368:12345-0@lo:503:mount.lustre.0 Request processed in 6145us (15757us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935704.829232:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784935704.829367:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784935704.829784:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784935704.829860:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784935704.829920:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.829982:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45465923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935704.830154:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292154496 00000100:00100000:0.0:1784935704.830160:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292154496 00000100:00100000:0.0:1784935704.830202:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784935704.830211:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4561d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:19517:x1871640292154496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784935704.830744:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4561d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:19517:x1871640292154496:12345-0@lo:502:mount.lustre.0 Request processed in 532us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935704.830753:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784935704.830963:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784935704.831250:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1784935704.831278:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1784935704.831291:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1784935704.831317:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1784935704.831330:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1784935704.831343:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1784935704.831355:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1784935704.831366:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1784935704.831378:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1784935704.831402:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784935704.831455:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.831526:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45465923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935704.833271:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292154624 00000100:00100000:0.0:1784935704.833284:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292154624 00000100:00100000:1.0:1784935704.836013:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784935704.836027:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:19517:x1871640292154624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784935704.836222:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:19517:x1871640292154624:12345-0@lo:502:mount.lustre.0 Request processed in 198us (4767us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.836231:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784935704.836411:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784935704.836496:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1784935704.836509:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1784935704.837723:0:19521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784935704.837731:0:19521:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1784935704.837737:0:19521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784935704.837740:0:19521:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1784935704.837745:0:19521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784935704.837758:0:19521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d45745c8000) 00000020:00000080:0.0:1784935704.837781:0:19521:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1784935704.837788:0:19521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784935704.837860:0:19521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457b962800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1784935704.837869:0:19521:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784935704.837877:0:19521:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x857e02f4e0b17a1c 00010000:00010000:0.0:1784935704.846091:0:19521:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1784935704.848095:0:19521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1784935704.852071:0:19521:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1784935704.853358:0:19521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1784935704.853370:0:19521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935704.853376:0:19521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935704.853378:0:19521:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1784935704.853381:0:19521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935704.853390:0:19521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935704.853392:0:19521:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784935704.853395:0:19521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784935704.853397:0:19521:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784935704.853399:0:19521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935704.853401:0:19521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935704.853402:0:19521:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784935704.853405:0:19521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784935704.853407:0:19521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935704.853408:0:19521:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784935704.853411:0:19521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1784935704.853437:0:19521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784935704.853439:0:19521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784935704.853441:0:19521:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784935704.853443:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1784935704.853841:0:19517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1784935704.853872:0:19517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784935704.853893:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528c00/0x857e02f4e0b17a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a0e expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.853906:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4541528c00/0x857e02f4e0b17a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a0e expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935704.853915:0:19517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457b962800 from 1 10000000:01000000:3.0:1784935704.853918:0:19517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784935704.853988:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.853996:0:19517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.854007:0:19517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935704.854031:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784935704.854090:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.854133:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45465920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935704.854264:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292154752 00000100:00100000:2.0:1784935704.854271:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292154752 00000100:00100000:2.0:1784935704.854327:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784935704.854336:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:19517:x1871640292154752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784935704.854349:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935704.854366:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d301600/0x857e02f4e0b17a2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17a23 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.854387:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d301600/0x857e02f4e0b17a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17a23 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.854398:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d301600/0x857e02f4e0b17a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17a23 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.854407:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d301600, rc 0) 00000100:00100000:2.0:1784935704.854443:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:19517:x1871640292154752:12345-0@lo:101:mount.lustre.0 Request processed in 108us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.854450:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784935704.857698:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784935704.857721:0:19517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935704.857744:0:19517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784935704.861789:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1784935704.862160:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784935704.862398:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1784935704.862492:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1784935704.862511:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1784935704.862516:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1784935704.862586:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784935704.862650:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.862744:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4546592cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935704.864167:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292154880 00000100:00100000:2.0:1784935704.864176:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292154880 00000100:00100000:2.0:1784935704.864271:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784935704.864281:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d454650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:19517:x1871640292154880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935704.864515:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d454650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:19517:x1871640292154880:12345-0@lo:501:mount.lustre.0 Request processed in 235us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.864523:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784935704.867083:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292154880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784935704.867140:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784935704.867210:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.867240:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4546592cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784935704.867364:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292155008 00000100:00100000:0.0:1784935704.867370:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292155008 00000100:00100000:0.0:1784935704.867516:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784935704.867527:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:19517:x1871640292155008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784935704.867635:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:19517:x1871640292155008:12345-0@lo:503:mount.lustre.0 Request processed in 109us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935704.867642:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784935704.867906:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155008:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784935704.869475:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784935704.869561:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784935704.869623:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.869660:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4543e6d480 going to sleep for 11 seconds 00000100:00100000:1.0:1784935704.869684:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292155136 00000100:00100000:1.0:1784935704.869691:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292155136 00000100:00100000:1.0:1784935704.869725:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784935704.869733:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:19517:x1871640292155136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784935704.869831:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:19517:x1871640292155136:12345-0@lo:502:mount.lustre.0 Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.869839:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784935704.869902:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784935704.870092:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1784935704.870118:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1784935704.870134:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1784935704.870157:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1784935704.870171:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1784935704.870199:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1784935704.870215:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1784935704.870229:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1784935704.870241:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1784935704.870254:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1784935704.870467:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1784935704.870488:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784935704.870525:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.870586:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45465920c0 going to sleep for 11 seconds 00010000:00010000:1.0:1784935704.877446:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935704.881036:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292155264 00000100:00100000:0.0:1784935704.881051:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292155264 00000100:00100000:1.0:1784935704.881285:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784935704.881307:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:19517:x1871640292155264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784935704.881477:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:19517:x1871640292155264:12345-0@lo:502:mount.lustre.0 Request processed in 181us (10950us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.881484:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784935704.881581:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784935704.881673:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1784935704.881687:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1784935704.883723:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935704.883735:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935704.883738:0:19525:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784935704.883745:0:19525:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d457b962800 00000020:00000080:3.0:1784935704.883748:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784935704.883755:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935704.883771:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935704.883772:0:19525:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784935704.883775:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935704.883777:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935704.883779:0:19525:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784935704.883782:0:19525:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d457b962800 00000020:00000080:3.0:1784935704.883785:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784935704.883870:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935704.883874:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935704.883876:0:19525:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784935704.883879:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935704.883889:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935704.883891:0:19525:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784935704.883895:0:19525:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d457b962800 00000020:00000080:3.0:1784935704.883897:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784935704.888646:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935704.888661:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935704.888663:0:19525:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784935704.888668:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784935704.888672:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935704.888673:0:19525:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784935704.888677:0:19525:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d457b962800 00000020:00000080:3.0:1784935704.888680:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784935704.888744:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784935704.888748:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784935704.888749:0:19525:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784935704.888753:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1784935704.888977:0:19517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1784935704.889008:0:19517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784935704.889024:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.889035:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784935704.889086:0:19517:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784935704.889099:0:19517:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d457b962800 10000000:01000000:2.0:1784935704.889102:0:19517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d457b962800 10000000:01000000:2.0:1784935704.889106:0:19517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784935704.889111:0:19517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d457b962800 from 1 10000000:01000000:2.0:1784935704.889113:0:19517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784935704.889148:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301a00/0x857e02f4e0b17a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.889157:0:19517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d301a00/0x857e02f4e0b17a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.889168:0:19517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d301a00/0x857e02f4e0b17a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935704.889192:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784935704.889255:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.889312:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581e3c540 going to sleep for 11 seconds 00000100:00100000:1.0:1784935704.889781:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292155392 00000100:00100000:1.0:1784935704.889789:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292155392 00000100:00100000:1.0:1784935704.889845:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784935704.889855:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:19517:x1871640292155392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784935704.889868:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935704.889879:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d1b9400/0x857e02f4e0b17a38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.889902:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b9400/0x857e02f4e0b17a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17a31 expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.889913:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d1b9400/0x857e02f4e0b17a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17a31 expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.889921:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9400, rc 0) 00000100:00100000:1.0:1784935704.890002:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292155392:12345-0@lo:101:mount.lustre.0 Request processed in 149us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.890008:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784935704.890369:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784935704.890384:0:19517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d301a00/0x857e02f4e0b17a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a38 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.890394:0:19517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d301a00/0x857e02f4e0b17a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17a38 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784935704.893198:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1784935704.893494:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784935704.893712:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1784935704.893736:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1784935704.893748:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1784935704.893758:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1784935704.893780:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1784935704.893793:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1784935704.893805:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1784935704.893817:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1784935704.893829:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1784935704.893842:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1784935704.893857:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1784935704.893870:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1784935704.893882:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1784935704.893894:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1784935704.893906:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1784935704.893919:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1784935704.893953:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1784935704.893969:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1784935704.893983:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1784935704.893997:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1784935704.894009:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1784935704.894021:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1784935704.894034:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1784935704.894048:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1784935704.894059:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1784935704.894070:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1784935704.894082:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1784935704.894096:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1784935704.894110:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1784935704.894477:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1784935704.894494:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1784935704.894508:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1784935704.894520:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1784935704.894533:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1784935704.894546:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1784935704.894560:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1784935704.894572:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1784935704.894596:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1784935704.894608:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1784935704.894621:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1784935704.894631:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1784935704.894642:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1784935704.894654:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1784935704.894668:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1784935704.894681:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1784935704.894706:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1784935704.894728:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1784935704.894733:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1784935704.894832:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935704.894892:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.894948:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45506f6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784935704.895348:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292155520 00000100:00100000:1.0:1784935704.895355:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292155520 00000100:00100000:1.0:1784935704.895394:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784935704.895403:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292155520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784935704.895516:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292155520:12345-0@lo:501:mount.lustre.0 Request processed in 114us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.895524:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784935704.897550:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784935704.897599:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784935704.897658:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.897687:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45506f6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784935704.899667:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292155648 00000100:00100000:1.0:1784935704.899679:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292155648 00000100:00100000:1.0:1784935704.899740:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784935704.899751:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292155648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784935704.900324:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292155648:12345-0@lo:503:mount.lustre.0 Request processed in 573us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.900339:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784935704.902580:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155648:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784935704.906997:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784935704.907088:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935704.907162:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.907204:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292155776 00000100:00100000:2.0:1784935704.907210:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292155776 00000100:00100000:2.0:1784935704.907249:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784935704.907256:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292155776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935704.907376:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292155776:12345-0@lo:502:mount.lustre.0 Request processed in 120us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.907389:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784935704.907557:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45436fff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784935704.907576:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784935704.907730:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1784935704.907754:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1784935704.907768:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1784935704.907783:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1784935704.907796:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1784935704.907808:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1784935704.907822:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1784935704.907835:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1784935704.907848:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1784935704.907863:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1784935704.907877:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1784935704.907902:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1784935704.907916:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1784935704.907945:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1784935704.907962:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1784935704.907976:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1784935704.907989:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1784935704.908002:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1784935704.908014:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1784935704.908027:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1784935704.908041:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1784935704.908054:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1784935704.908067:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1784935704.908080:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1784935704.908093:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1784935704.908106:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1784935704.908119:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1784935704.908151:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1784935704.908166:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1784935704.908179:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1784935704.908189:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1784935704.908201:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1784935704.908212:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1784935704.908224:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1784935704.908236:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1784935704.908249:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1784935704.909848:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1784935704.909916:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1784935704.909950:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1784935704.909965:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1784935704.909978:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1784935704.909991:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1784935704.910004:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1784935704.910031:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1784935704.910047:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1784935704.910061:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1784935704.910074:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1784935704.910086:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1784935704.910139:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935704.910209:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.910252:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292155904 00000100:00100000:2.0:1784935704.910254:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45436fff00 going to sleep for 11 seconds 00000100:00100000:1.0:1784935704.910259:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292155904 00000100:00100000:1.0:1784935704.910313:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784935704.910322:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292155904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784935704.917200:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292155904:12345-0@lo:502:mount.lustre.0 Request processed in 6870us (6982us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.917213:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784935704.923969:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292155904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784935704.924189:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1784935704.924218:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1784935704.924254:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292156032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935704.925555:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935704.925595:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292156032 00000100:00100000:2.0:1784935704.925607:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292156032 00000100:00100000:2.0:1784935704.925661:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784935704.925670:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292156032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784935704.926130:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292156032:12345-0@lo:502:mount.lustre.0 Request processed in 460us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935704.926139:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784935704.926188:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581e3c540 going to sleep for 11 seconds 00000100:00100000:2.0:1784935704.926207:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292156032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784935704.926346:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1784935704.926359:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1784935704.929543:0:19531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1784935704.929561:0:19531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d45745c99c0) 00000020:00000080:0.0:1784935704.929584:0:19531:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1784935704.929750:0:19531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457b962800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784935704.929754:0:19531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d457b962800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784935704.929906:0:19531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457b962800 3 00010000:00080000:0.0:1784935704.929954:0:19531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d44422d9800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.128@tcp at head 00010000:00010000:1.0:1784935704.941496:0:19531:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1784935704.941603:0:19531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1784935704.941663:0:19531:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784935704.941675:0:19531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x857e02f4e0b17a46 00000100:00080000:1.0:1784935704.941686:0:19531:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784935704.941692:0:19531:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d44422d9800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935704.941725:0:19531:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443d09180 x1871640292156160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784935704.942228:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1871640292156160:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784935704.942315:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.942375:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292156160 00000100:00100000:1.0:1784935704.942381:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292156160 00000100:00100000:1.0:1784935704.942474:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784935704.942481:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1871640292156160:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784935704.942503:0:17198:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:1.0:1784935704.942533:0:17198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x857e02f4e0b17a4d 00000004:00100000:1.0:1784935704.942547:0:17198:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784935704.942582:0:17198:0:(import.c:65:import_set_state_nolock()) ffff8d4570c45000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935704.942631:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871640292156160:12345-0@lo:38:llog_process_th.0 Request processed in 149us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.942638:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1784935704.942673:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443d09180 x1871640292156160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935704.942681:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784935704.942689:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1784935704.942695:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784935704.942699:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784935704.942701:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44422d9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784935704.942707:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1871640292156160:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1784935704.942723:0:19531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1784935704.943197:0:19531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1784935704.943220:0:19531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d4442250000) 00000020:00000080:0.0:1784935704.943238:0:19531:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00080000:1.0:1784935704.943502:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935704.943506:0:15171:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784935704.943508:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8d4573e19000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935704.943513:0:15171:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1784935704.943516:0:15171:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784935704.943520:0:15171:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d4573e19000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935704.943536:0:15171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4443d0ad80 x1871640292156544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784935704.943567:0:15171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784935704.943570:0:15171:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784935704.943572:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784935704.943575:0:15171:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1784935704.943582:0:15171:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784935704.943586:0:15171:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d455126f800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:1.0:1784935704.943598:0:15171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574032300 x1871640292157056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784935704.943637:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292156288:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.943678:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.943701:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292156928:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.943724:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.943745:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784935704.943750:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292156800:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.943782:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.943797:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292157440:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.943815:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.943837:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292156416:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.943858:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.943871:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292157184:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.943886:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.943899:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784935704.943904:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292156672:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.943919:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.943945:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292157312:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.943962:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.944584:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292156288 00000100:00100000:1.0:1784935704.944591:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292156288 00000100:00100000:1.0:1784935704.944629:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292156800 00000100:00100000:1.0:1784935704.944639:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292156800 00000100:00100000:1.0:1784935704.944656:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784935704.944662:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292156288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.944715:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292156288:12345-0@lo:400:kworker.0 Request processed in 52us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.944721:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784935704.944736:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784935704.944741:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292156800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.945965:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292156800:12345-0@lo:400:kworker.0 Request processed in 1217us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.946026:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784935704.946067:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292156928 00000100:00100000:1.0:1784935704.946073:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292156928 00000100:00100000:1.0:1784935704.946108:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292156416 00000100:00100000:1.0:1784935704.946111:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292156416 00000100:00100000:1.0:1784935704.946129:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784935704.946134:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292156928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.946179:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292156928:12345-0@lo:400:kworker.0 Request processed in 44us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.946185:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784935704.946196:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784935704.946202:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292156416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.946233:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292156416:12345-0@lo:400:kworker.0 Request processed in 32us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.946239:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784935704.946570:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292157440 00000100:00100000:1.0:1784935704.946575:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292157440 00000100:00100000:1.0:1784935704.946613:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292157184 00000100:00100000:1.0:1784935704.946616:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292157184 00000100:00100000:1.0:1784935704.946627:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292156672 00000100:00100000:1.0:1784935704.946630:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292156672 00000100:00100000:1.0:1784935704.946639:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292157312 00000100:00100000:1.0:1784935704.946642:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292157312 00000100:00100000:1.0:1784935704.946653:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784935704.946658:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292157440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.946693:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292157440:12345-0@lo:400:kworker.0 Request processed in 34us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.946700:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784935704.946710:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784935704.946715:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292157184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.946740:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292157184:12345-0@lo:400:kworker.0 Request processed in 25us (2852us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.947260:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784935704.947344:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784935704.947351:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292156672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.947383:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292156672:12345-0@lo:400:kworker.0 Request processed in 35us (3463us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.947388:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784935704.947397:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784935704.947403:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292157312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.947719:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292157312:12345-0@lo:400:kworker.0 Request processed in 316us (3755us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935704.947725:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784935704.948641:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292156800:0@lo:400:kworker.0 00010000:00080000:1.0:1784935704.948672:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574032d80 x1871640292157440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935704.948683:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292157440:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.948695:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292156288:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.948706:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292156928:0@lo:400:kworker.0 00010000:00080000:1.0:1784935704.948747:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443d09c00 x1871640292156672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935704.948841:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292156672:0@lo:400:kworker.0 00010000:00080000:1.0:1784935704.948857:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574031500 x1871640292157312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935704.948867:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292157312:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.948880:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292156416:0@lo:400:kworker.0 00010000:00080000:1.0:1784935704.948890:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574031880 x1871640292157184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935704.948897:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292157184:0@lo:400:kworker.0 00000100:00100000:1.0:1784935704.948967:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292156544:0@lo:8:kworker.0 00000100:00100000:1.0:1784935704.949092:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.949125:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292157056:0@lo:8:kworker.0 00000100:00100000:1.0:1784935704.949145:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935704.949375:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292156544 00000100:00100000:3.0:1784935704.949381:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292156544 00000100:00100000:3.0:1784935704.949419:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292157056 00000100:00100000:3.0:1784935704.949422:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292157056 00000100:00100000:3.0:1784935704.949434:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784935704.949439:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1871640292156544:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1784935704.949492:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1871640292156544:12345-0@lo:8:kworker.0 Request processed in 51us (399us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784935704.949498:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784935704.949509:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784935704.949513:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1871640292157056:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1784935704.949535:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1871640292157056:12345-0@lo:8:kworker.0 Request processed in 21us (389us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784935704.949540:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000004:0.0:1784935704.949708:0:19531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d457b962800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784935704.949713:0:19531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d457b962800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784935704.949716:0:19531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d457b962800 3 00010000:00080000:0.0:1784935704.949772:0:19531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d44422dd000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.128@tcp at head 00000100:00100000:1.0:1784935704.950922:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784935704.950945:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4573e19000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784935704.950958:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784935704.950963:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292156544:0@lo:8:kworker.0 00000100:00100000:1.0:1784935704.951120:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784935704.951124:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784935704.951128:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784935704.951131:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292157056:0@lo:8:kworker.0 00010000:00010000:0.0:1784935704.953187:0:19531:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1784935704.962252:0:19531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1784935704.962328:0:19531:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784935704.962342:0:19531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x857e02f4e0b17a5b 00000100:00080000:0.0:1784935704.962359:0:19531:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784935704.962365:0:19531:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d44422dd000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:0.0:1784935704.962398:0:19531:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d4574004a80 x1871640292157568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784935704.962425:0:19531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1784935704.962963:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1871640292157568:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784935704.963047:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935704.967397:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292157568 00000100:00100000:0.0:1784935704.967422:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292157568 00000100:00100000:0.0:1784935704.967476:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784935704.967485:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1871640292157568:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784935704.967535:0:18430:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:0.0:1784935704.967570:0:18430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x857e02f4e0b17a62 00000004:00100000:0.0:1784935704.967587:0:18430:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784935704.967619:0:18430:0:(import.c:65:import_set_state_nolock()) ffff8d44422db000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784935704.967708:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871640292157568:12345-0@lo:38:llog_process_th.0 Request processed in 223us (4659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935704.967715:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784935704.967766:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574004a80 x1871640292157568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784935714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935704.967777:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784935704.967785:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1784935704.967792:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784935704.967796:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784935704.967798:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d44422dd000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784935704.967805:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1871640292157568:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1784935704.967913:0:19531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1784935704.971363:0:19517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784935704.971473:0:19517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784935704.971529:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301a00/0x857e02f4e0b17a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a38 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.971544:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d301a00/0x857e02f4e0b17a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a38 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784935704.971592:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784935704.971594:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784935704.971595:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935704.971597:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935704.971598:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935704.971599:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935704.971601:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784935704.971603:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935704.971604:0:19517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784935704.971607:0:19517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1784935704.971609:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784935704.971611:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784935704.971612:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935704.971613:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935704.971614:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935704.971620:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935704.971621:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784935704.971622:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935704.971623:0:19517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784935704.971647:0:19517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784935704.971668:0:19517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292157696:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784935704.971734:0:19517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.971790:0:19517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2780 going to sleep for 11 seconds 00000100:00100000:2.0:1784935704.972256:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292157696 00000100:00100000:2.0:1784935704.972373:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292157696 00000100:00100000:2.0:1784935704.972493:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784935704.972503:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292157696:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784935704.972532:0:17192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784935704.972545:0:17192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784935704.984881:0:17192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784935704.984901:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784935704.984920:0:17213:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784935704.984957:0:17213:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784935704.984982:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.985001:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b17919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17912 expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.985009:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d457d1b8e00/0x857e02f4e0b17927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17920 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.985017:0:17213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.985058:0:17213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d457d1b8e00/0x857e02f4e0b17927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b17920 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935704.985072:0:17213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d457d1b8e00/0x857e02f4e0b17927 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b17920 expref: 24 pid: 17192 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935704.985086:0:17213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292157824:0@lo:104: 00000100:00100000:1.0:1784935704.985163:0:17213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784935704.985208:0:17213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b17919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b17912 expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935704.985221:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:19517:x1871640292157696:12345-0@lo:253:mount.lustre.0 Request processed in 12719us (13485us total) trans 0 rc 0/0 00010000:00010000:1.0:1784935704.985230:0:17213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b17919 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b17912 expref: 24 pid: 17191 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935704.985231:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784935704.985239:0:17213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574031500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292157952:0@lo:104: 00000100:00100000:1.0:1784935704.985260:0:17213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935704.985274:0:17213:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457d3f2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784935704.985319:0:19517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c8b4eee-3769-4cc8-9dd4-4824356c9813:19517:1871640292157696:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784935704.985331:0:19517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784935704.985334:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784935704.985335:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784935704.985336:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784935704.985338:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784935704.985339:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784935704.985340:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784935704.985341:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784935704.985343:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784935704.985344:0:19517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784935704.985357:0:19517:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784935704.985380:0:17182:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292157824 00000100:00100000:0.0:1784935704.985386:0:17182:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292157824 00000100:00100000:0.0:1784935704.985424:0:17182:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292157952 00000100:00100000:0.0:1784935704.985427:0:17182:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292157952 00000100:00100000:0.0:1784935704.985440:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784935704.985448:0:17182:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+4:17213:x1871640292157824:12345-0@lo:104: 00010000:00010000:0.0:1784935704.985459:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985502:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935704.985507:0:17182:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+4:17213:x1871640292157824:12345-0@lo:104: Request processed in 60us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935704.985513:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784935704.985526:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784935704.985532:0:17182:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:17213:x1871640292157952:12345-0@lo:104: 00010000:00010000:0.0:1784935704.985539:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985568:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784935704.985574:0:17182:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:17213:x1871640292157952:12345-0@lo:104: Request processed in 43us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935704.985580:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1784935704.985595:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784935704.985600:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985608:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9c00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935704.985612:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985631:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935704.985638:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935704.985644:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935704.985670:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985677:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935704.985696:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985704:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d1b9c00/0x857e02f4e0b17920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17927 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985716:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935704.985719:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985725:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8600 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935704.985728:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985735:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935704.985741:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935704.985752:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784935704.985782:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985788:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935704.985803:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985810:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17919 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.985823:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.985825:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.985826:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935704.985880:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935704.985890:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292158080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935704.985918:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935704.985967:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292158208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784935704.986390:0:17213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292157824:0@lo:104: 00000100:00100000:2.0:1784935704.986400:0:17213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574031500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17213:1871640292157952:0@lo:104: 00010000:00010000:2.0:1784935704.986427:0:17213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935704.986583:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935704.986637:0:17185:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292158080 00000100:00100000:0.0:1784935704.986642:0:17185:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292158080 00010000:00010000:0.0:1784935704.986660:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d457d1b8e00/0x857e02f4e0b17927 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17920 expref: 24 pid: 17192 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935704.986680:0:17185:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292158208 00000100:00100000:0.0:1784935704.986682:0:17185:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292158208 00010000:00010000:0.0:1784935704.986693:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b17919 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17912 expref: 25 pid: 17191 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935704.986718:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784935704.986725:0:17185:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+25:3650:x1871640292158080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784935704.986902:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935704.986909:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d457d1b8e00/0x857e02f4e0b17927 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17920 expref: 25 pid: 17192 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.986919:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d457d1b8e00/0x857e02f4e0b17927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b17920 expref: 25 pid: 17192 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987041:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d1b8e00/0x857e02f4e0b17927 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b17920 expref: 25 pid: 17192 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987053:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935704.987084:0:17185:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3650:x1871640292158080:12345-0@lo:103:ldlm_bl.0 Request processed in 360us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935704.987090:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784935704.987104:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784935704.987110:0:17185:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574006d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:3651:x1871640292158208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784935704.987118:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935704.987122:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b17919 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17912 expref: 23 pid: 17191 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987130:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b17919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b17912 expref: 23 pid: 17191 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987139:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443699a00/0x857e02f4e0b17919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b17912 expref: 23 pid: 17191 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987160:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987310:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784935704.987326:0:17185:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007222081s 00010000:00010000:0.0:1784935704.987331:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987338:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987346:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987352:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987358:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9800 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935704.987362:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987370:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987391:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935704.987401:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935704.987444:0:17185:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574006d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:3651:x1871640292158208:12345-0@lo:103:ldlm_bl.0 Request processed in 333us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935704.987450:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784935704.987477:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292158080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935704.987501:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292158208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784935704.988190:0:17213:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.988209:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935704.988215:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d1b9800/0x857e02f4e0b17a69 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1784935704.997244:0:19517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1784935705.009159:0:19517:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1784935705.009175:0:19517:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1784935705.009227:0:19517:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784935705.009286:0:19517:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.128@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784935705.009365:0:19517:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1784935705.009397:0:19517:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1784935705.010604:0:19517:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784935705.011008:0:19517:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1784935705.839199:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784935705.901420:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784935706.452527:0:19584:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784935706.452761:0:19584:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1784935706.806377:0:17194:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784935706.806386:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4443d3b800 from 10 10000000:01000000:2.0:1784935706.806391:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784935706.806450:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301000/0x857e02f4e0b17a70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935706.806465:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d301000/0x857e02f4e0b17a70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935706.806478:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d301000/0x857e02f4e0b17a70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935706.806511:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292158336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784935706.806603:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935706.806654:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549153180 going to sleep for 11 seconds 00000100:00100000:2.0:1784935706.806767:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292158336 00000100:00100000:2.0:1784935706.806775:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292158336 00000100:00100000:2.0:1784935706.806835:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784935706.806846:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:17194:x1871640292158336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784935706.806863:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935706.806879:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d301800/0x857e02f4e0b17a77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17a70 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935706.806924:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d301800/0x857e02f4e0b17a77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17a70 expref: 23 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935706.806958:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d301800/0x857e02f4e0b17a77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17a70 expref: 23 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935706.806969:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d301800, rc 0) 00000100:00100000:2.0:1784935706.807015:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:17194:x1871640292158336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935706.807022:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784935706.807084:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292158336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784935706.807100:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d301000/0x857e02f4e0b17a70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a77 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935706.807109:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d301000/0x857e02f4e0b17a70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17a77 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935706.807165:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292158464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784935706.807198:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935706.807212:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549153180 going to sleep for 11 seconds 00000100:00100000:2.0:1784935706.807225:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292158464 00000100:00100000:2.0:1784935706.807229:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292158464 00000100:00100000:2.0:1784935706.807257:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784935706.807263:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:17194:x1871640292158464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784935706.807279:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784935706.814583:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784935706.814595:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1784935706.814787:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:17194:x1871640292158464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 7517us (7582us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935706.814802:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784935706.814922:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292158464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784935706.815037:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784935706.815050:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d301000/0x857e02f4e0b17a70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a77 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935706.815061:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d301000/0x857e02f4e0b17a70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a77 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784935706.815073:0:17194:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784935706.815076:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d4443cc0000 from 10 10000000:01000000:3.0:1784935706.815079:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784935706.815120:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541529a00/0x857e02f4e0b17a7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935706.815129:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4541529a00/0x857e02f4e0b17a7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935706.815139:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4541529a00/0x857e02f4e0b17a7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935706.815161:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292158592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784935706.815200:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935706.815235:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4581f0cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784935706.815422:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292158592 00000100:00100000:2.0:1784935706.815430:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292158592 00000100:00100000:2.0:1784935706.815549:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784935706.815560:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:17194:x1871640292158592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784935706.815577:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935706.815593:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b17a85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17a7e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935706.815624:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b17a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17a7e expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935706.815637:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d300a00/0x857e02f4e0b17a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17a7e expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935706.815648:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300a00, rc 0) 00000100:00100000:2.0:1784935706.815816:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:17194:x1871640292158592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935706.815823:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784935706.820918:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292158592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935706.821035:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4541529a00/0x857e02f4e0b17a7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a85 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935706.821051:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4541529a00/0x857e02f4e0b17a7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17a85 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935706.828143:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292158720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784935706.828246:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935706.828388:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549a57180 going to sleep for 11 seconds 00000100:00100000:3.0:1784935706.828626:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292158720 00000100:00100000:3.0:1784935706.828635:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292158720 00000100:00100000:3.0:1784935706.828698:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784935706.828709:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4560ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:17194:x1871640292158720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784935706.828736:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784935706.828758:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784935706.828762:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1784935706.828867:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4560ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:17194:x1871640292158720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935706.828875:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784935706.828979:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292158720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784935706.829058:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784935706.829070:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4541529a00/0x857e02f4e0b17a7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a85 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935706.829083:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4541529a00/0x857e02f4e0b17a7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17a85 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935706.925220:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935707.571068:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784935707.571102:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292158848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935707.571192:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935707.571842:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292158848 00000100:00100000:2.0:1784935707.571854:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292158848 00000100:00100000:2.0:1784935707.571972:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784935707.571985:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292158848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784935707.572045:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784935707.572120:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292158848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935707.572128:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784935707.572188:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292158848:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784935707.572447:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784935707.950885:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935708.977372:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935709.101248:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784935709.101288:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292158976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784935709.101385:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935709.101603:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292158976 00000100:00100000:0.0:1784935709.101615:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292158976 00000100:00100000:0.0:1784935709.101687:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784935709.101698:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292158976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935709.101745:0:17938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784935709.101820:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292158976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935709.101828:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784935709.102101:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292158976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935709.103474:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784935709.103499:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292159104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935709.103583:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935709.103644:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292159104 00000100:00100000:2.0:1784935709.103653:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292159104 00000100:00100000:2.0:1784935709.103710:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784935709.103719:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292159104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784935709.103759:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784935709.103807:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292159104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935709.103814:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784935709.103859:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292159104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784935709.614293:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784935709.614326:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292159232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935709.614420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935709.614667:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292159232 00000100:00100000:2.0:1784935709.614677:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292159232 00000100:00100000:2.0:1784935709.614758:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784935709.614769:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292159232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784935709.614810:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784935709.614870:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292159232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935709.614878:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784935709.614984:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292159232:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784935709.616007:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784935709.998229:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784935710.126276:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935710.126282:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784935710.126286:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d4573e19000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784935710.126298:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d4573e19000 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935710.126319:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d444359bb80 x1871640292159744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784935710.126356:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784935710.126359:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784935710.126361:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784935710.126366:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d455126f800 using connection 192.168.203.128@tcp/0@lo 00000100:00100000:2.0:1784935710.126377:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d444359b100 x1871640292160256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784935710.126429:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292159360:0@lo:400:kworker.0 00000100:00100000:2.0:1784935710.126504:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935710.126547:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292160000:0@lo:400:kworker.0 00000100:00100000:2.0:1784935710.126692:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935710.126713:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292160640:0@lo:400:kworker.0 00000100:00100000:2.0:1784935710.126742:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935710.126841:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292159744:0@lo:8:kworker.0 00000100:00100000:0.0:1784935710.126874:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935710.126891:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292160256:0@lo:8:kworker.0 00000100:00100000:0.0:1784935710.126908:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935710.126960:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292159488:0@lo:400:kworker.0 00000100:00100000:0.0:1784935710.126982:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935710.127041:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292159872:0@lo:400:kworker.0 00000100:00100000:1.0:1784935710.127084:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935710.127102:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292160512:0@lo:400:kworker.0 00000100:00100000:1.0:1784935710.127125:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935710.127139:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292160128:0@lo:400:kworker.0 00000100:00100000:1.0:1784935710.127162:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292160640 00000100:00100000:1.0:1784935710.127170:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292160640 00000100:00100000:0.0:1784935710.127175:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935710.127195:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292160768:0@lo:400:kworker.0 00000100:00100000:1.0:1784935710.127218:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292159872 00000100:00100000:1.0:1784935710.127223:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292159872 00000100:00100000:0.0:1784935710.127223:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935710.127241:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784935710.127242:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292160512 00000100:00100000:1.0:1784935710.127246:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292160512 00000100:00100000:0.0:1784935710.127251:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292159616:0@lo:400:kworker.0 00000100:00100000:1.0:1784935710.127273:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292160768 00000100:00100000:1.0:1784935710.127277:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292160768 00000100:00100000:1.0:1784935710.127294:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784935710.127301:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292160640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935710.127356:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292160640:12345-0@lo:400:kworker.0 Request processed in 54us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935710.127361:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935710.127369:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784935710.127385:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292160384:0@lo:400:kworker.0 00000100:00100000:1.0:1784935710.127396:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784935710.127404:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292159872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935710.127410:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935710.127422:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292160896:0@lo:400:kworker.0 00000100:00100000:1.0:1784935710.127449:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292159872:12345-0@lo:400:kworker.0 Request processed in 45us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935710.127514:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935710.127536:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292160000 00000100:00100000:0.0:1784935710.127539:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292160000 00000100:00100000:0.0:1784935710.127563:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292159488 00000100:00100000:0.0:1784935710.127566:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292159488 00000100:00100000:0.0:1784935710.127577:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784935710.127583:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292160000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935710.127615:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292160000:12345-0@lo:400:kworker.0 Request processed in 31us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935710.127621:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784935710.127633:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784935710.127640:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292159488:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1784935710.127676:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443cd6d80 x1871640292160640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935710.127685:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292159488:12345-0@lo:400:kworker.0 Request processed in 44us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935710.127695:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292160640:0@lo:400:kworker.0 00000100:00100000:0.0:1784935710.127696:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784935710.127715:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292160384 00000100:00100000:0.0:1784935710.127720:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292160384 00000100:00100000:2.0:1784935710.127727:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292160000:0@lo:400:kworker.0 00000100:00100000:1.0:1784935710.127755:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784935710.127823:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292160896 00000100:00100000:0.0:1784935710.127826:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292160896 00000100:00100000:1.0:1784935710.127835:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784935710.127844:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292160512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935710.127849:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784935710.127858:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292160768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935710.127889:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1871640292160512:12345-0@lo:400:kworker.0 Request processed in 45us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935710.127896:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784935710.127903:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292160768:12345-0@lo:400:kworker.0 Request processed in 46us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935710.127912:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784935710.128863:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784935710.128888:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784935710.128893:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292160384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935710.128902:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292160896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935710.128982:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292160896:12345-0@lo:400:kworker.0 Request processed in 84us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935710.129021:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292159360 00000100:00100000:2.0:1784935710.129028:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292159360 00000100:00100000:0.0:1784935710.129054:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784935710.129068:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784935710.129076:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3652:x1871640292159360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935710.129084:0:18705:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292159744 00000100:00100000:0.0:1784935710.129089:0:18705:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292159744 00000100:00100000:0.0:1784935710.129103:0:18705:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292160256 00000100:00100000:0.0:1784935710.129106:0:18705:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292160256 00000100:00100000:0.0:1784935710.129115:0:18705:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292160128 00000100:00100000:0.0:1784935710.129118:0:18705:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292160128 00000100:00100000:2.0:1784935710.129124:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3652:x1871640292159360:12345-0@lo:400:kworker.0 Request processed in 47us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935710.129132:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784935710.129139:0:18705:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292159616 00000100:00100000:0.0:1784935710.129143:0:18705:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292159616 00000100:00100000:0.0:1784935710.129162:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784935710.129170:0:18705:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292160128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935710.129181:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292159360:0@lo:400:kworker.0 00000100:00100000:0.0:1784935710.129208:0:18705:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292160128:12345-0@lo:400:kworker.0 Request processed in 39us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935710.129216:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784935710.129227:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784935710.129232:0:18705:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292159616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935710.129270:0:18705:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292159616:12345-0@lo:400:kworker.0 Request processed in 22us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935710.129288:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784935710.129300:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784935710.129304:0:18705:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1871640292159744:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784935710.129329:0:18705:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1784935710.129355:0:18705:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x857e02f4e0b17a8c 00002000:00100000:0.0:1784935710.129367:0:18705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d44422da000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784935710.129372:0:18705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784935710.129375:0:18705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784935710.129636:0:18705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1784935710.129643:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292160384:12345-0@lo:400:kworker.0 Request processed in 760us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935710.129652:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1784935710.129658:0:18705:0:(import.c:65:import_set_state_nolock()) ffff8d44422df800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935710.129681:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784935710.129688:0:18703:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1871640292160256:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1784935710.129706:0:18703:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000100:00100000:0.0:1784935710.129715:0:18705:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1871640292159744:12345-0@lo:8:kworker.0 Request processed in 408us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935710.129722:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:00000080:1.0:1784935710.129726:0:18703:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x857e02f4e0b17a93 00002000:00100000:1.0:1784935710.129735:0:18703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d4441b23000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1784935710.129739:0:18703:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1784935710.129741:0:18703:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784935710.129785:0:18703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1784935710.129797:0:18703:0:(import.c:65:import_set_state_nolock()) ffff8d4441b26800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935710.129832:0:18703:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1871640292160256:12345-0@lo:8:kworker.0 Request processed in 143us (2922us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935710.129846:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784935710.129850:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292159616:0@lo:400:kworker.0 00010000:00080000:0.0:1784935710.129867:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443432a00 x1871640292160384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784935710.129872:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935710.129879:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935710.129882:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292160384:0@lo:400:kworker.0 00000100:00080000:1.0:1784935710.129883:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784935710.129897:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443cd7100 x1871640292160896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935710.129908:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292160896:0@lo:400:kworker.0 00010000:00080000:1.0:1784935710.129918:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444359b480 x1871640292159872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935710.129924:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292159488:0@lo:400:kworker.0 00000100:00100000:1.0:1784935710.129962:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292159872:0@lo:400:kworker.0 00000100:00100000:0.0:1784935710.129962:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292160128:0@lo:400:kworker.0 00010000:00080000:1.0:1784935710.129982:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443cd7480 x1871640292160512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935710.129991:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1871640292160512:0@lo:400:kworker.0 00010000:00080000:0.0:1784935710.130060:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443cd7b80 x1871640292160768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935710.130069:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292160768:0@lo:400:kworker.0 00010000:00080000:2.0:1784935710.130128:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444359bb80 x1871640292159744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784935735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784935710.130141:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1784935710.130156:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784935710.130161:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784935710.130163:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d4573e19000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784935710.130191:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784935710.130195:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1871640292159744:0@lo:8:kworker.0 00000004:00080000:1.0:1784935710.130305:0:17224:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000004:00080000:0.0:1784935710.130314:0:17223:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1784935710.130325:0:17224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17224:1871640292161152:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784935710.130363:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1784935710.130375:0:17223:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 529380446325ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784935710.130382:0:17223:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1784935710.130384:0:17224:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4544e6fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784935710.130398:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935710.130407:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292161024:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1784935710.130416:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444359b100 x1871640292160256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784935735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784935710.130427:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00100000:1.0:1784935710.130432:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784935710.130513:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784935710.130517:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784935710.130519:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8d455126f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784935710.130534:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784935710.130539:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1871640292160256:0@lo:8:kworker.0 00000004:00080000:0.0:1784935710.130557:0:17941:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784935710.130595:0:17941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 529380666921ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784935710.130600:0:17941:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1784935710.130616:0:18705:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292161152 00000100:00100000:0.0:1784935710.130620:0:18705:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292161152 00000100:00100000:1.0:1784935710.130649:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292161024 00000100:00100000:0.0:1784935710.130651:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784935710.130657:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292161024 00000100:00100000:0.0:1784935710.130662:0:18705:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17224:x1871640292161152:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784935710.130693:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784935710.130701:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1871640292161024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784935710.130722:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784935710.130773:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1871640292161024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935710.130780:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1784935710.130806:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784935710.130826:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4574032300 x1871640292161024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935710.130840:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292161024:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1784935710.132705:0:17930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1784935710.133676:0:17942:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1784935710.133687:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292161280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935710.133701:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17942:1871640292161408:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1784935710.135055:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935710.139561:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935710.139625:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292161280 00000100:00100000:0.0:1784935710.139635:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292161280 00000100:00100000:0.0:1784935710.139696:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784935710.139705:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3652:x1871640292161280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935710.139731:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1784935710.139797:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935710.139797:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3652:x1871640292161280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935710.139808:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784935710.140010:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4572a59900 going to sleep for 11 seconds 00000100:00100000:1.0:1784935710.140121:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292161408 00000100:00100000:1.0:1784935710.140127:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292161408 00000100:00100000:1.0:1784935710.140160:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784935710.140168:0:18703:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17942:x1871640292161408:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1784935710.140322:0:17178:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:0.0:1784935710.140545:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443cd6d80 x1871640292161280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784935726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935710.140567:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292161280:0@lo:13:osp-pre-1-1.0 00002000:00080000:0.0:1784935710.140596:0:18705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1784935710.140605:0:18705:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1784935710.140610:0:18705:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:1.0:1784935710.147540:0:18703:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1784935710.147550:0:18703:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1784935710.147859:0:18703:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17942:x1871640292161408:12345-0@lo:7:osp-pre-1-1.0 Request processed in 7688us (12802us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935710.147869:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1784935710.147964:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443cd4700 x1871640292161408/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784935726 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935710.147979:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17942:1871640292161408:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1784935710.147992:0:17942:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1784935710.148045:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443667800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17942:1871640292161536:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1784935710.148078:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935710.148102:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4544e6f780 going to sleep for 11 seconds 00000100:00100000:1.0:1784935710.148119:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292161536 00000100:00100000:1.0:1784935710.148124:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292161536 00000100:00100000:1.0:1784935710.148160:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784935710.148177:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1871640292161536:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1784935710.148202:0:19236:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1784935710.148246:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1871640292161536:12345-0@lo:5:osp-pre-1-1.0 Request processed in 58us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935710.148253:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1784935710.148295:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443667800 x1871640292161536/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784935726 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935710.148304:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443667800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17942:1871640292161536:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1784935710.148312:0:17942:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1784935710.148335:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443667800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17942:1871640292161664:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1784935710.148357:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935710.148370:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4544e6f780 going to sleep for 11 seconds 00000100:00100000:1.0:1784935710.148381:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292161664 00000100:00100000:1.0:1784935710.148385:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292161664 00000100:00100000:1.0:1784935710.148405:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784935710.148411:0:18703:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17942:x1871640292161664:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1784935710.148434:0:18703:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:1.0:1784935710.156220:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.156240:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17a9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.156267:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.156272:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.156278:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.156307:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.156723:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.156732:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.156751:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784935710.157096:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935710.157105:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.157116:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8a00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935710.157121:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.157131:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.157151:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17a9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.157159:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17a9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.157182:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.157189:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.157192:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784935710.157558:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784935710.157565:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6d4b829/0x857e02f4e0b17aa1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.157576:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1784935710.157580:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935710.157586:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6d4b829/0x857e02f4e0b17aa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.157597:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6d4b829/0x857e02f4e0b17aa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.157605:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6d4b829/0x857e02f4e0b17aa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.157613:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6d4b829/0x857e02f4e0b17aa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.157639:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784935710.157789:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935710.157796:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6d4b829/0x857e02f4e0b17aa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.157815:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699a00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935710.157818:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6d4b829/0x857e02f4e0b17aa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.157826:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6d4b829/0x857e02f4e0b17aa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784935710.160569:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784935710.160581:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aa8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.160597:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1784935710.160601:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935710.160607:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.160630:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.160641:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.160648:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.160664:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784935710.160676:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935710.161009:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.161029:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161038:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935710.161043:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161051:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aa8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161082:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aa8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161099:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aa8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161115:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.161117:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.161118:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784935710.161153:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784935710.161158:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17aaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161167:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1784935710.161170:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935710.161174:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17aaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161183:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17aaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161190:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17aaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161197:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161208:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784935710.161297:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935710.161307:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161313:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935710.161316:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161322:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17aaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161332:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17aaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161338:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17aaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.161356:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.161358:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.161359:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.161364:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.161365:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935710.161665:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6d4b829/0x857e02f4e0b17aa1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.161674:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6d4b829/0x857e02f4e0b17aa1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.161689:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935710.161690:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935710.161692:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784935710.163398:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935710.163408:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5aebeab/0x857e02f4e0b17ab6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.163422:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1784935710.163426:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935710.163433:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5aebeab/0x857e02f4e0b17ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.163444:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5aebeab/0x857e02f4e0b17ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.163462:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5aebeab/0x857e02f4e0b17ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.163470:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5aebeab/0x857e02f4e0b17ab6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.163491:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784935710.163870:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784935710.163878:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5aebeab/0x857e02f4e0b17ab6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.163889:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935710.163894:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5aebeab/0x857e02f4e0b17ab6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.163904:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5aebeab/0x857e02f4e0b17ab6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.163921:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5aebeab/0x857e02f4e0b17ab6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.163949:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5aebeab/0x857e02f4e0b17ab6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.163985:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935710.163988:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935710.163991:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784935710.165274:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935710.165285:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de6386d/0x857e02f4e0b17abd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.165298:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1784935710.165302:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935710.165308:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007de6386d/0x857e02f4e0b17abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.165319:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007de6386d/0x857e02f4e0b17abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.165327:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de6386d/0x857e02f4e0b17abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.165334:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007de6386d/0x857e02f4e0b17abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.165362:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784935710.165585:0:19714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935710.165593:0:19714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007de6386d/0x857e02f4e0b17abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.165600:0:19714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935710.165603:0:19714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007de6386d/0x857e02f4e0b17abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.165622:0:19714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007de6386d/0x857e02f4e0b17abd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.165638:0:19714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007de6386d/0x857e02f4e0b17abd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.165645:0:19714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007de6386d/0x857e02f4e0b17abd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.165661:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.165663:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.165664:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784935710.166817:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784935710.166828:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b677469c/0x857e02f4e0b17ac4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.179911:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1784935710.179940:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935710.179948:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b677469c/0x857e02f4e0b17ac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.179965:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b677469c/0x857e02f4e0b17ac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.179977:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b677469c/0x857e02f4e0b17ac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.179985:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b677469c/0x857e02f4e0b17ac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.180519:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784935710.181504:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784935710.181516:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014b5e43f/0x857e02f4e0b17acb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.181532:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1784935710.181536:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935710.181543:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014b5e43f/0x857e02f4e0b17acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.181574:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014b5e43f/0x857e02f4e0b17acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.181585:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014b5e43f/0x857e02f4e0b17acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.181593:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014b5e43f/0x857e02f4e0b17acb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.181625:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784935710.181664:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784935710.181673:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b677469c/0x857e02f4e0b17ac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.181684:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300800 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935710.181689:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b677469c/0x857e02f4e0b17ac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.181699:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b677469c/0x857e02f4e0b17ac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.181719:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b677469c/0x857e02f4e0b17ac4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.181727:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b677469c/0x857e02f4e0b17ac4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.181748:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784935710.181752:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014b5e43f/0x857e02f4e0b17acb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.181759:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529800 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935710.181768:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014b5e43f/0x857e02f4e0b17acb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.181776:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014b5e43f/0x857e02f4e0b17acb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.181871:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935710.182043:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014b5e43f/0x857e02f4e0b17acb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.182053:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014b5e43f/0x857e02f4e0b17acb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.182069:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935710.182071:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935710.182073:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784935710.182169:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784935710.182179:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb333956/0x857e02f4e0b17ad2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.182190:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1784935710.182194:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935710.182200:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb333956/0x857e02f4e0b17ad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.182212:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb333956/0x857e02f4e0b17ad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.182221:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb333956/0x857e02f4e0b17ad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.182246:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb333956/0x857e02f4e0b17ad2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.182278:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784935710.183181:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784935710.183188:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adc62a1e/0x857e02f4e0b17ad9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.183198:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1784935710.183202:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935710.183207:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adc62a1e/0x857e02f4e0b17ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.183217:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adc62a1e/0x857e02f4e0b17ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.183225:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adc62a1e/0x857e02f4e0b17ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.183232:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adc62a1e/0x857e02f4e0b17ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.183248:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784935710.183708:0:19714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784935710.183715:0:19714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb333956/0x857e02f4e0b17ad2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.183724:0:19714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935710.183728:0:19714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb333956/0x857e02f4e0b17ad2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.183736:0:19714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb333956/0x857e02f4e0b17ad2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.183751:0:19714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb333956/0x857e02f4e0b17ad2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.183769:0:19714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb333956/0x857e02f4e0b17ad2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.183784:0:19714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935710.183787:0:19714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adc62a1e/0x857e02f4e0b17ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.183793:0:19714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935710.183796:0:19714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adc62a1e/0x857e02f4e0b17ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.183804:0:19714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adc62a1e/0x857e02f4e0b17ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.183815:0:19714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adc62a1e/0x857e02f4e0b17ad9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.183822:0:19714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adc62a1e/0x857e02f4e0b17ad9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.183834:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.183835:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.183837:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784935710.184128:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784935710.184134:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e974246/0x857e02f4e0b17ae0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.184149:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1784935710.184152:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784935710.184157:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e974246/0x857e02f4e0b17ae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.184166:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e974246/0x857e02f4e0b17ae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.184174:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e974246/0x857e02f4e0b17ae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.184180:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e974246/0x857e02f4e0b17ae0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.184194:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935710.184202:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935710.184206:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e974246/0x857e02f4e0b17ae0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.184212:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935710.184215:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e974246/0x857e02f4e0b17ae0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.184221:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e974246/0x857e02f4e0b17ae0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.184241:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e974246/0x857e02f4e0b17ae0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.184247:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e974246/0x857e02f4e0b17ae0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.184270:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.184272:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.184273:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935710.186805:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784935710.188360:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784935710.188377:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17ae7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.188407:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1784935710.188413:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935710.188420:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.188437:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.188449:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.188457:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.188481:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784935710.188498:0:19714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935710.188504:0:19714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.188514:0:19714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935710.188519:0:19714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.188529:0:19714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17ae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.188566:0:19714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17ae7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.188575:0:19714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c34ec564/0x857e02f4e0b17ae7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.188592:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.188594:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.188596:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784935710.191036:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784935710.191052:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.191068:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1784935710.191073:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935710.191080:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.191094:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.191108:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.191116:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.191156:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935710.191180:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935710.191188:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.191197:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443699e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935710.191203:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.191213:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.191231:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.191238:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f096e6c/0x857e02f4e0b17aee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.191279:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.191281:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.191283:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784935710.194583:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784935710.194604:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a4fd5a5/0x857e02f4e0b17af5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.194622:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1784935710.194626:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935710.194633:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a4fd5a5/0x857e02f4e0b17af5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.194650:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a4fd5a5/0x857e02f4e0b17af5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.194660:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a4fd5a5/0x857e02f4e0b17af5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.194668:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a4fd5a5/0x857e02f4e0b17af5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784935710.194684:0:19518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1784935710.194724:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1784935710.194731:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784935710.194906:0:18703:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17942:x1871640292161664:12345-0@lo:5:osp-pre-1-1.0 Request processed in 46488us (46542us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784935710.194994:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784935710.195296:0:17942:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1784935710.195304:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443667800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17942:1871640292161664:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1784935710.195319:0:17942:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1784935710.195369:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17942:1871640292161792:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1784935710.195405:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935710.195440:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4547eabc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784935710.195480:0:17209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292161792 00000100:00100000:2.0:1784935710.195486:0:17209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292161792 00010000:00010000:0.0:1784935710.195497:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784935710.195529:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784935710.195539:0:17209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1871640292161792:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1784935710.195592:0:17209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1871640292161792:12345-0@lo:900:osp-pre-1-1.0 Request processed in 55us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935710.195601:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784935710.195639:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443cd5c00 x1871640292161792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784935726 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935710.195649:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17942:1871640292161792:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1784935710.197351:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935710.197364:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a4fd5a5/0x857e02f4e0b17af5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.197379:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443698000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935710.197384:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a4fd5a5/0x857e02f4e0b17af5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.197396:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a4fd5a5/0x857e02f4e0b17af5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.197417:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a4fd5a5/0x857e02f4e0b17af5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.197426:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a4fd5a5/0x857e02f4e0b17af5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.197446:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.197448:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.197450:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784935710.198746:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.198757:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17afc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.198772:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.198776:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.198783:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.198797:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.198808:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.198823:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.198848:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784935710.199765:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.199775:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.199787:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.199792:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.199797:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.199808:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.199817:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.199824:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.199845:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784935710.200038:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784935710.200046:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.200068:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935710.200072:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.200080:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17afc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.200097:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17afc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.200106:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17afc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.200123:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935710.200127:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.200133:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935710.200137:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.200145:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.200155:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.200168:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.200181:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.200183:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.200184:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.200693:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784935710.201195:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.201205:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.201224:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.201228:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.201244:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.202550:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.202733:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.202741:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.202760:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935710.203564:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935710.203572:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.203583:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9c00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935710.203587:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.203597:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.203614:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.203621:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.203640:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.203642:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.203644:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784935710.206653:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.206667:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.206683:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.206688:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.206694:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.206706:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.206728:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.206736:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.206760:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935710.206880:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935710.206889:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.206899:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935710.206903:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.206912:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.207066:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.207075:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.207089:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.207092:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.207093:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784935710.209481:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.209494:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b17b18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.209509:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.209513:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.209518:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b17b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.209531:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b17b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.209541:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b17b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.209549:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b17b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.209580:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784935710.210115:0:19714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935710.210122:0:19714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b17b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.210131:0:19714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935710.210142:0:19714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b17b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.210151:0:19714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b17b18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.210166:0:19714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b17b18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.210173:0:19714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7717d86/0x857e02f4e0b17b18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.210187:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.210189:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.210191:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784935710.212580:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.212603:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e653a05/0x857e02f4e0b17b1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.212619:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.212623:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.212628:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e653a05/0x857e02f4e0b17b1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.212640:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e653a05/0x857e02f4e0b17b1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.212649:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e653a05/0x857e02f4e0b17b1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.212656:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e653a05/0x857e02f4e0b17b1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.212685:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784935710.213746:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.213756:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091c53448/0x857e02f4e0b17b26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.213767:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.213777:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.213782:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091c53448/0x857e02f4e0b17b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.213794:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091c53448/0x857e02f4e0b17b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.213802:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091c53448/0x857e02f4e0b17b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.213808:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091c53448/0x857e02f4e0b17b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.213833:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784935710.214414:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784935710.214423:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e653a05/0x857e02f4e0b17b1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.214433:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9800 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935710.214437:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e653a05/0x857e02f4e0b17b1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.214459:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e653a05/0x857e02f4e0b17b1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.214474:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e653a05/0x857e02f4e0b17b1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.214482:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e653a05/0x857e02f4e0b17b1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.214499:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935710.214502:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091c53448/0x857e02f4e0b17b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.214510:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8400 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935710.214512:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091c53448/0x857e02f4e0b17b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.214519:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091c53448/0x857e02f4e0b17b26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.214529:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091c53448/0x857e02f4e0b17b26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.214537:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091c53448/0x857e02f4e0b17b26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.214569:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935710.214570:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935710.214572:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.214698:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784935710.214807:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.214814:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009019d3da/0x857e02f4e0b17b2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.214823:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.214826:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.214831:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009019d3da/0x857e02f4e0b17b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.214841:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009019d3da/0x857e02f4e0b17b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.214849:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009019d3da/0x857e02f4e0b17b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.214864:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009019d3da/0x857e02f4e0b17b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.214885:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784935710.215487:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.215494:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.215503:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.215507:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.215511:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.215520:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.215529:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.215537:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.215557:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784935710.215584:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784935710.215589:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009019d3da/0x857e02f4e0b17b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.215595:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935710.215597:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009019d3da/0x857e02f4e0b17b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.215603:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009019d3da/0x857e02f4e0b17b2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.215612:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009019d3da/0x857e02f4e0b17b2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.215616:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009019d3da/0x857e02f4e0b17b2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.215626:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784935710.215628:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.215632:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:2.0:1784935710.215638:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.215643:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.215648:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.215652:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c075ff1b/0x857e02f4e0b17b34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935710.215659:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935710.215660:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784935710.215661:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.215697:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784935710.216176:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.216183:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.216200:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.216203:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.216208:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.216217:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.216226:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.216244:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.216365:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784935710.217071:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.217080:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.217090:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.217094:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.217098:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.217110:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.217130:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.217137:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.217183:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784935710.217190:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.217199:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9c00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935710.217204:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.217214:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.217266:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.217274:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099957b11/0x857e02f4e0b17b3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.217292:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935710.217296:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.217304:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935710.217308:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.217317:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.217336:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b42 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935710.217345:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.217347:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935710.217349:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784935710.217690:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784935710.217696:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b47dcafe/0x857e02f4e0b17b42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.217973:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784935710.218221:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.218227:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17b49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.218253:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.218263:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.218269:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.218280:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.218288:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.218306:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.218336:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935710.218387:0:19714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935710.218395:0:19714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.218404:0:19714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935710.218407:0:19714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.218428:0:19714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17b49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.218441:0:19714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17b49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.218447:0:19714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b583135/0x857e02f4e0b17b49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.218461:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.218463:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.218465:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784935710.218884:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.218891:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17b50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.218902:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.218905:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.218909:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.218948:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.218957:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.218963:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.218982:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935710.219080:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935710.219085:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.219103:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8a00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935710.219107:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.219114:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17b50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.219126:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17b50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.219146:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd47a62a/0x857e02f4e0b17b50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.219161:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.219163:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.219165:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784935710.219455:0:18705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784935710.219462:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b17b57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.219475:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1784935710.219477:0:18705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935710.219482:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b17b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.219490:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b17b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.219497:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b17b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.219504:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b17b57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935710.219524:0:18705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784935710.219585:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935710.219591:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b17b57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.219598:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935710.219602:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b17b57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.219610:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b17b57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.219622:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b17b57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.219629:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a82e837/0x857e02f4e0b17b57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935710.219642:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.219643:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935710.219645:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784935710.219836:0:18705:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1784935710.220004:0:18705:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17224:x1871640292161152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 89340us (89636us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935710.220013:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784935710.222002:0:17224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17224:1871640292161152:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784935710.222214:0:17224:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1784935710.222377:0:17224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d457402f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17224:1871640292161920:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784935710.222430:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935710.222459:0:17224:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45541f0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784935710.222529:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292161920 00000100:00100000:1.0:1784935710.222535:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292161920 00000100:00100000:1.0:1784935710.222597:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784935710.222606:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17224:x1871640292161920:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784935710.222642:0:19236:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1784935710.231191:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17224:x1871640292161920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8579us (8754us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1784935710.231215:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784935710.231215:0:17224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d457402f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17224:1871640292161920:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784935710.231240:0:17224:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1784935711.024049:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784935711.599539:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784935712.046172:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784935712.356757:0:19875:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg328-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784935712.685752:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292162048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784935712.685818:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935712.685920:0:18708:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292162048 00000100:00100000:3.0:1784935712.685945:0:18708:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292162048 00000100:00100000:3.0:1784935712.686002:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784935712.686011:0:18708:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292162048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784935712.686039:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1784935712.691097:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935712.693353:0:18708:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292162048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7334us (7525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935712.693363:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292162048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784935712.693371:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1784935713.074248:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784935713.181667:0:19927:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784935713.181890:0:19927:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1784935713.901185:0:19977:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784935713.901418:0:19977:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784935714.093127:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935714.132859:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935714.133078:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273209088 00000100:00100000:1.0:1784935714.133090:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273209088 00000100:00100000:1.0:1784935714.133137:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 114 00000100:00100000:1.0:1784935714.133144:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2390:x1871640273209088:12345-192.168.203.28@tcp:250:mount.lustre.0 00010000:00080000:1.0:1784935714.133172:0:17191:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 07085f05-e0be-469f-87e0-210ab47bba20@192.168.203.28@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1784935714.133273:0:17191:0:(genops.c:1406:class_connect()) connect: client 07085f05-e0be-469f-87e0-210ab47bba20, cookie 0x857e02f4e0b17b5e 00000100:00080000:1.0:1784935714.133408:0:17191:0:(import.c:65:import_set_state_nolock()) ffff8d4441b25800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935714.133471:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+5:2390:x1871640273209088:12345-192.168.203.28@tcp:250:mount.lustre.0 Request processed in 325us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935714.133478:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 114 00000100:00100000:1.0:1784935714.150921:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935714.151154:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273209216 00000100:00100000:3.0:1784935714.151165:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273209216 00000100:00100000:3.0:1784935714.151228:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 115 00000100:00100000:3.0:1784935714.151247:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+5:14885:x1871640273209216:12345-192.168.203.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784935714.151265:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935714.151282:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541528200/0x857e02f4e0b17b65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313acf8 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935714.151327:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541528200/0x857e02f4e0b17b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acf8 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935714.151337:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541528200/0x857e02f4e0b17b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acf8 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935714.151345:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541528200, rc 0) 00000100:00100000:3.0:1784935714.151404:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+6:14885:x1871640273209216:12345-192.168.203.28@tcp:101:mount.lustre.0 Request processed in 159us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935714.151410:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 115 00000100:00100000:3.0:1784935714.156561:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935714.159281:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273209344 00000100:00100000:1.0:1784935714.159295:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273209344 00000100:00100000:1.0:1784935714.159359:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 116 00000100:00100000:1.0:1784935714.159370:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+6:14885:x1871640273209344:12345-192.168.203.28@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784935714.159505:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+6:14885:x1871640273209344:12345-192.168.203.28@tcp:501:mount.lustre.0 Request processed in 135us (2965us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784935714.159513:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 116 00000100:00100000:2.0:1784935714.175800:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935714.179876:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273209472 00000100:00100000:0.0:1784935714.179891:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273209472 00000100:00100000:0.0:1784935714.180162:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 117 00000100:00100000:0.0:1784935714.180174:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+6:14885:x1871640273209472:12345-192.168.203.28@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784935714.180191:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935714.180220:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443699e00/0x857e02f4e0b17b6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313acff expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935714.180258:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443699e00/0x857e02f4e0b17b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acff expref: 7 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935714.180269:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443699e00/0x857e02f4e0b17b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313acff expref: 7 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935714.180279:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443699e00, rc 0) 00000100:00100000:0.0:1784935714.180337:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+7:14885:x1871640273209472:12345-192.168.203.28@tcp:101:mount.lustre.0 Request processed in 165us (4546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935714.180344:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 117 00000100:00100000:2.0:1784935714.184371:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935714.186379:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273209600 00000100:00100000:0.0:1784935714.186393:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273209600 00000100:00100000:0.0:1784935714.186469:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 118 00000100:00100000:0.0:1784935714.186478:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+7:14885:x1871640273209600:12345-192.168.203.28@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784935714.186625:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+8:14885:x1871640273209600:12345-192.168.203.28@tcp:501:mount.lustre.0 Request processed in 148us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935714.186633:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 118 00000100:00100000:1.0:1784935714.190248:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935714.190436:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273209728 00000100:00100000:0.0:1784935714.190460:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273209728 00000100:00100000:0.0:1784935714.190514:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 119 00000100:00100000:0.0:1784935714.190525:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+8:14885:x1871640273209728:12345-192.168.203.28@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784935714.190663:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+8:14885:x1871640273209728:12345-192.168.203.28@tcp:503:mount.lustre.0 Request processed in 140us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935714.190670:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 119 00000100:00100000:2.0:1784935714.197189:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935714.197616:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273209856 00000100:00100000:1.0:1784935714.197626:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273209856 00000100:00100000:1.0:1784935714.197894:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 120 00000100:00100000:1.0:1784935714.197907:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+8:14903:x1871640273209856:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784935714.199637:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+8:14903:x1871640273209856:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 1722us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935714.199650:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 120 00000100:00100000:1.0:1784935714.221299:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935714.221324:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292162176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784935714.221396:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935714.222607:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935714.222623:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292162304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784935714.222666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935714.229370:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292162176 00000100:00100000:0.0:1784935714.229385:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292162176 00000100:00100000:2.0:1784935714.229487:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292162304 00000100:00100000:2.0:1784935714.229491:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292162304 00000100:00100000:2.0:1784935714.229554:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784935714.229563:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292162304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784935714.229602:0:17938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784935714.229829:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292162304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935714.229880:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292162304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 318us (7213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935714.229901:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784935714.230356:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784935714.230366:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292162176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784935714.230386:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784935714.230431:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292162176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (9035us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935714.230437:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784935714.230494:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292162176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784935714.231133:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935714.233468:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273209984 00000100:00100000:0.0:1784935714.233481:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273209984 00000100:00100000:2.0:1784935714.236965:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 121 00000100:00100000:2.0:1784935714.236980:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+8:14903:x1871640273209984:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784935714.237161:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+8:14903:x1871640273209984:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 184us (6031us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935714.237170:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 121 00000100:00100000:3.0:1784935714.255093:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935714.255918:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273210112 00000100:00100000:1.0:1784935714.255956:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273210112 00000100:00100000:1.0:1784935714.256020:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 122 00000100:00100000:1.0:1784935714.256030:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+8:14903:x1871640273210112:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784935714.256179:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+8:14903:x1871640273210112:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 150us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935714.256188:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 122 00000100:00100000:0.0:1784935714.261770:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935714.261838:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273210240 00000100:00100000:2.0:1784935714.261849:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273210240 00000100:00100000:2.0:1784935714.261911:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 123 00000100:00100000:2.0:1784935714.261920:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+8:14885:x1871640273210240:12345-192.168.203.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784935714.261960:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935714.261979:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b17b73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313ad30 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935714.262006:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b17b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad30 expref: 9 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935714.262016:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d301c00/0x857e02f4e0b17b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad30 expref: 9 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935714.262038:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d301c00, rc 0) 00000100:00100000:2.0:1784935714.262097:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+9:14885:x1871640273210240:12345-192.168.203.28@tcp:101:mount.lustre.0 Request processed in 178us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935714.262104:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 123 00000100:00100000:2.0:1784935714.270132:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935714.270826:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273210368 00000100:00100000:3.0:1784935714.270837:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273210368 00000100:00100000:3.0:1784935714.270895:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 124 00000100:00100000:3.0:1784935714.270906:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45741b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+9:14885:x1871640273210368:12345-192.168.203.28@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784935714.274559:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784935714.274595:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784935714.274599:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784935714.274602:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784935714.274605:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784935714.274607:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1784935714.277901:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45741b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+9:14885:x1871640273210368:12345-192.168.203.28@tcp:256:mount.lustre.0 Request processed in 6981us (7761us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935714.277915:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 124 00000100:00100000:0.0:1784935714.284342:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935714.284516:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273210496 00000100:00100000:1.0:1784935714.284527:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273210496 00000100:00100000:1.0:1784935714.284586:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 125 00000100:00100000:1.0:1784935714.284596:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45705ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+9:14885:x1871640273210496:12345-192.168.203.28@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784935714.284635:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935714.284653:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b17b7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313ad37 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935714.284684:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b17b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad37 expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935714.284696:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b17b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad37 expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935714.284705:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8400, rc 0) 00000100:00100000:1.0:1784935714.285014:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45705ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+10:14885:x1871640273210496:12345-192.168.203.28@tcp:101:mount.lustre.0 Request processed in 418us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935714.285020:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 125 00000100:00100000:1.0:1784935714.295199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935714.295703:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273210624 00000100:00100000:2.0:1784935714.295713:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273210624 00000100:00100000:2.0:1784935714.295771:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 126 00000100:00100000:2.0:1784935714.295781:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45705ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+10:14885:x1871640273210624:12345-192.168.203.28@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784935714.296402:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45705ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+10:14885:x1871640273210624:12345-192.168.203.28@tcp:501:mount.lustre.0 Request processed in 621us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935714.296410:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 126 00000100:00100000:0.0:1784935714.300831:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935714.301375:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273210752 00000100:00100000:1.0:1784935714.301384:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273210752 00000100:00100000:1.0:1784935714.301423:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 127 00000100:00100000:1.0:1784935714.301431:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45705af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+10:14885:x1871640273210752:12345-192.168.203.28@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784935714.301564:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45705af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+10:14885:x1871640273210752:12345-192.168.203.28@tcp:503:mount.lustre.0 Request processed in 132us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935714.301571:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 127 00000100:00100000:1.0:1784935714.304727:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935714.304857:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273210880 00000100:00100000:2.0:1784935714.304866:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273210880 00000100:00100000:2.0:1784935714.304919:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 128 00000100:00100000:2.0:1784935714.304958:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+10:14908:x1871640273210880:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784935714.305121:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+10:14908:x1871640273210880:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 193us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935714.305129:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 128 00000100:00100000:2.0:1784935714.310718:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935714.310815:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273211008 00000100:00100000:0.0:1784935714.310824:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273211008 00000100:00100000:0.0:1784935714.310878:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 129 00000100:00100000:0.0:1784935714.310896:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+10:14908:x1871640273211008:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784935714.311080:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+10:14908:x1871640273211008:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 194us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935714.311089:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 129 00000100:00100000:0.0:1784935714.316018:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935714.316115:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935714.316210:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273211136 00000100:00100000:2.0:1784935714.316219:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273211136 00000100:00100000:2.0:1784935714.316274:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273211392 00000100:00100000:2.0:1784935714.316277:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273211392 00000100:00100000:2.0:1784935714.316304:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:2.0:1784935714.316313:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1871640273211136:12345-192.168.203.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784935714.316341:0:18430:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 5d45adfc-e178-41b7-9e70-f7155e381607@192.168.203.28@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:2.0:1784935714.316399:0:18430:0:(genops.c:1406:class_connect()) connect: client 5d45adfc-e178-41b7-9e70-f7155e381607, cookie 0x857e02f4e0b17b81 00000004:00100000:2.0:1784935714.316422:0:18430:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1784935714.316616:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 8 00000100:00100000:3.0:1784935714.316624:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1871640273211392:12345-192.168.203.28@tcp:38:mount.lustre.0 00000100:00080000:2.0:1784935714.316627:0:18430:0:(import.c:65:import_set_state_nolock()) ffff8d4581e89000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1784935714.316643:0:17198:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 5d45adfc-e178-41b7-9e70-f7155e381607@192.168.203.28@tcp t0 exp 0000000000000000 cur 533 last 0 00000100:00100000:2.0:1784935714.316692:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+6:2390:x1871640273211136:12345-192.168.203.28@tcp:38:mount.lustre.0 Request processed in 379us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935714.316700:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 7 00000020:00000080:3.0:1784935714.316744:0:17198:0:(genops.c:1406:class_connect()) connect: client 5d45adfc-e178-41b7-9e70-f7155e381607, cookie 0x857e02f4e0b17b88 00000004:00100000:3.0:1784935714.316761:0:17198:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784935714.316897:0:17198:0:(import.c:65:import_set_state_nolock()) ffff8d4581eba800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784935714.317132:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+6:2390:x1871640273211392:12345-192.168.203.28@tcp:38:mount.lustre.0 Request processed in 505us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935714.317141:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 8 00000100:00100000:0.0:1784935714.332922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935714.333088:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935714.333107:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273211520 00000100:00100000:2.0:1784935714.333118:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273211520 00000100:00100000:1.0:1784935714.333158:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273211264 00000100:00100000:1.0:1784935714.333165:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273211264 00000100:00080000:3.0:1784935714.333191:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784935714.333198:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784935714.333202:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 9 00000100:00100000:2.0:1784935714.333212:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+6:0:x1871640273211520:12345-192.168.203.28@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784935714.333257:0:18430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784935714.333343:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+6:0:x1871640273211520:12345-192.168.203.28@tcp:41:mount.lustre.0 Request processed in 132us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935714.345223:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00100000:1.0:1784935714.345258:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+6:0:x1871640273211264:12345-192.168.203.28@tcp:41:mount.lustre.0 00000100:00100000:2.0:1784935714.345346:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 9 00000100:00100000:3.0:1784935714.345472:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935714.345494:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273211648 00000100:00100000:3.0:1784935714.345500:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273211648 00000100:00100000:3.0:1784935714.345527:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00100000:3.0:1784935714.345535:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+7:14885:x1871640273211648:12345-192.168.203.28@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784935714.345554:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784935714.345627:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+7:14885:x1871640273211648:12345-192.168.203.28@tcp:41:mount.lustre.0 Request processed in 93us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935714.345633:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 11 00000004:00000024:1.0:1784935714.346607:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784935714.346663:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+6:0:x1871640273211264:12345-192.168.203.28@tcp:41:mount.lustre.0 Request processed in 1418us (13574us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935714.346671:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00100000:3.0:1784935714.354285:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935714.354994:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273211776 00000100:00100000:2.0:1784935714.355005:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273211776 00000100:00100000:2.0:1784935714.355075:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 12 00000100:00100000:2.0:1784935714.355085:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+6:14885:x1871640273211776:12345-192.168.203.28@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784935714.355171:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+6:14885:x1871640273211776:12345-192.168.203.28@tcp:40:mount.lustre.0 Request processed in 87us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935714.355178:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 12 00000100:00100000:3.0:1784935714.359715:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935714.359756:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935714.359792:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935714.359880:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273211904 00000100:00100000:0.0:1784935714.359889:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273211904 00000100:00100000:0.0:1784935714.359962:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273212032 00000100:00100000:0.0:1784935714.359966:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273212032 00000100:00100000:0.0:1784935714.359985:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:0.0:1784935714.359994:0:18703:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1871640273211904:12345-192.168.203.28@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784935714.360024:0:18703:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 5d45adfc-e178-41b7-9e70-f7155e381607@192.168.203.28@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1784935714.360053:0:18703:0:(genops.c:1406:class_connect()) connect: client 5d45adfc-e178-41b7-9e70-f7155e381607, cookie 0x857e02f4e0b17b8f 00002000:00100000:0.0:1784935714.360064:0:18703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5d45adfc-e178-41b7-9e70-f7155e381607/ffff8d44422da800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784935714.360081:0:18703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784935714.360257:0:18703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784935714.360284:0:18703:0:(import.c:65:import_set_state_nolock()) ffff8d44422dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784935714.360344:0:18703:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d45adfc-e178-41b7-9e70-f7155e381607+6:2390:x1871640273211904:12345-192.168.203.28@tcp:8:mount.lustre.0 Request processed in 350us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935714.360352:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:0.0:1784935714.360368:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:0.0:1784935714.360372:0:18703:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1871640273212032:12345-192.168.203.28@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784935714.360390:0:18703:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 5d45adfc-e178-41b7-9e70-f7155e381607@192.168.203.28@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1784935714.360405:0:18703:0:(genops.c:1406:class_connect()) connect: client 5d45adfc-e178-41b7-9e70-f7155e381607, cookie 0x857e02f4e0b17b96 00002000:00100000:0.0:1784935714.360410:0:18703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5d45adfc-e178-41b7-9e70-f7155e381607/ffff8d44422dc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784935714.360420:0:18703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784935714.360518:0:18703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784935714.360533:0:18703:0:(import.c:65:import_set_state_nolock()) ffff8d44422de800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784935714.360558:0:18703:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d45adfc-e178-41b7-9e70-f7155e381607+6:2390:x1871640273212032:12345-192.168.203.28@tcp:8:mount.lustre.0 Request processed in 184us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935714.360565:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:2.0:1784935714.361408:0:17209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273212160 00000100:00100000:2.0:1784935714.361415:0:17209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273212160 00000100:00100000:2.0:1784935714.361460:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 3 00000100:00100000:2.0:1784935714.361469:0:17209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5d45adfc-e178-41b7-9e70-f7155e381607+6:14885:x1871640273212160:12345-192.168.203.28@tcp:900:mount.lustre.0 00000100:00100000:2.0:1784935714.361528:0:17209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5d45adfc-e178-41b7-9e70-f7155e381607+6:14885:x1871640273212160:12345-192.168.203.28@tcp:900:mount.lustre.0 Request processed in 61us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935714.361535:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 3 00000100:00100000:3.0:1784935714.374729:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935714.375030:0:17200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273212288 00000100:00100000:0.0:1784935714.375041:0:17200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273212288 00000100:00100000:0.0:1784935714.375095:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 0 00000100:00100000:0.0:1784935714.375107:0:17200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45adfc-e178-41b7-9e70-f7155e381607+6:14885:x1871640273212288:12345-192.168.203.28@tcp:33:mount.lustre.0 00000004:00080000:1.0:1784935714.376117:0:17200:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 925us 00000004:00200000:1.0:1784935714.393835:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784935714.393972:0:17200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45adfc-e178-41b7-9e70-f7155e381607+6:14885:x1871640273212288:12345-192.168.203.28@tcp:33:mount.lustre.0 Request processed in 18862us (19248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935714.393987:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 0 00000100:00100000:1.0:1784935714.569912:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935714.575021:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273212416 00000100:00100000:2.0:1784935714.575036:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273212416 00000100:00100000:2.0:1784935714.575123:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 13 00000100:00100000:2.0:1784935714.575136:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+6:14931:x1871640273212416:12345-192.168.203.28@tcp:101:mkdir.0 00010000:00010000:2.0:1784935714.575157:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935714.575182:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17b9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ad68 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935714.575434:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b17ba4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935714.575449:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b17ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935714.575480:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b17ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935714.575533:0:17197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784935714.575537:0:17197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935714.575569:0:17197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b17ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935714.575595:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17b9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad68 expref: 8 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935714.575614:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b17ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad68 expref: 7 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935714.575622:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4442a6bb00) 00010000:00010000:2.0:1784935714.575625:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784935714.575628:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300800, rc 0) 00000100:00100000:2.0:1784935714.575710:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+7:14931:x1871640273212416:12345-192.168.203.28@tcp:101:mkdir.0 Request processed in 577us (5805us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935714.575717:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 13 00000100:00100000:2.0:1784935714.733385:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784935714.733409:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292162432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784935714.733477:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935714.733682:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292162432 00000100:00100000:3.0:1784935714.733689:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292162432 00000100:00100000:3.0:1784935714.733759:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784935714.733770:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292162432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935714.733791:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784935714.733834:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292162432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935714.733841:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1784935714.733897:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935714.733951:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292162432:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1784935715.056198:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784935715.117193:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935715.245828:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292162816:0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.245909:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935715.245972:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292163328:0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.245994:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935715.246008:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292163840:0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246027:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935715.246046:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784935715.246051:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292162944:0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246067:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935715.246087:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292163456:0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246102:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935715.246112:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292163968:0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246131:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935715.246158:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292162816 00000100:00100000:2.0:1784935715.246165:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292162816 00000100:00100000:2.0:1784935715.246210:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292163328 00000100:00100000:2.0:1784935715.246213:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292163328 00000100:00100000:2.0:1784935715.246277:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292162944 00000100:00100000:2.0:1784935715.246280:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292162944 00000100:00100000:2.0:1784935715.246289:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292163456 00000100:00100000:2.0:1784935715.246291:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292163456 00000100:00100000:2.0:1784935715.246303:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784935715.246309:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292162816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246352:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292162816:12345-0@lo:400:kworker.0 Request processed in 43us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935715.246360:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784935715.246372:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784935715.246377:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292163328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246398:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292163328:12345-0@lo:400:kworker.0 Request processed in 22us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935715.246409:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784935715.246419:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935715.246423:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1871640292162944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246456:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1871640292162944:12345-0@lo:400:kworker.0 Request processed in 33us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935715.246462:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784935715.246471:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784935715.246475:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292163456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246493:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292163456:12345-0@lo:400:kworker.0 Request processed in 18us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935715.246498:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1784935715.246509:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784935715.246513:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935715.246535:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292162944:0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246543:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292163456:0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246551:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292162816:0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246558:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292163328:0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246583:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292163840 00000100:00100000:2.0:1784935715.246586:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292163840 00000100:00080000:2.0:1784935715.246598:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784935715.246615:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292163968 00000100:00100000:2.0:1784935715.246617:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292163968 00000100:00080000:2.0:1784935715.246625:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935715.246640:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784935715.246646:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292163840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246682:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1871640292163840:12345-0@lo:400:kworker.0 Request processed in 36us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935715.246688:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784935715.246699:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784935715.246705:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292163968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.246727:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1871640292163968:12345-0@lo:400:kworker.0 Request processed in 23us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935715.246732:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784935715.246754:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1871640292163968:0@lo:400:kworker.0 00010000:00080000:2.0:1784935715.246764:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d444359aa00 x1871640292163840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935715.246773:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1871640292163840:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247089:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292162688:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247121:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935715.247149:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292163200:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247168:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935715.247200:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292163712:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247221:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935715.247248:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1784935715.247255:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292162560:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247279:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935715.247300:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292163072:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247320:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935715.247335:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292163584:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247355:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935715.247365:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292164096:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247381:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935715.247405:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292162688 00000100:00100000:0.0:1784935715.247410:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292162688 00000100:00100000:0.0:1784935715.247435:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292163200 00000100:00100000:0.0:1784935715.247438:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292163200 00000100:00100000:0.0:1784935715.247450:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784935715.247464:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292162688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247500:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292162688:12345-0@lo:400:kworker.0 Request processed in 36us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935715.247505:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784935715.247517:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784935715.247522:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292163200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247545:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292163200:12345-0@lo:400:kworker.0 Request processed in 23us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935715.247552:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784935715.247566:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292162560 00000100:00100000:0.0:1784935715.247569:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292162560 00000100:00100000:0.0:1784935715.247591:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784935715.247596:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3650:x1871640292162560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247621:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3650:x1871640292162560:12345-0@lo:400:kworker.0 Request processed in 25us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935715.247627:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784935715.247657:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292163712 00000100:00100000:0.0:1784935715.247661:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292163712 00000100:00100000:0.0:1784935715.247681:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292163072 00000100:00100000:0.0:1784935715.247683:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292163072 00000100:00100000:0.0:1784935715.247691:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292163584 00000100:00100000:0.0:1784935715.247693:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292163584 00000100:00100000:0.0:1784935715.247702:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292164096 00000100:00100000:0.0:1784935715.247704:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292164096 00000100:00100000:0.0:1784935715.247718:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784935715.247723:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292163712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247748:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292163712:12345-0@lo:400:kworker.0 Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935715.247759:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784935715.247771:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784935715.247777:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292163072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247801:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292163072:12345-0@lo:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935715.247807:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784935715.247816:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784935715.247820:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292163584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.247843:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1871640292163584:12345-0@lo:400:kworker.0 Request processed in 22us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935715.247849:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784935715.247859:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784935715.247865:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292164096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.248028:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1871640292164096:12345-0@lo:400:kworker.0 Request processed in 163us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935715.248034:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1784935715.248049:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935715.248053:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935715.248086:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292162560:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.248098:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292163072:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.248105:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1871640292163584:0@lo:400:kworker.0 00010000:00080000:0.0:1784935715.248117:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443d9bb80 x1871640292164096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935715.248137:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1871640292164096:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.248149:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292162688:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.248157:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292163200:0@lo:400:kworker.0 00000100:00100000:0.0:1784935715.248166:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292163712:0@lo:400:kworker.0 00000100:00100000:2.0:1784935715.248663:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292164224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935715.248698:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935715.249665:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292164224 00000100:00100000:3.0:1784935715.249673:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292164224 00000100:00100000:3.0:1784935715.249708:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784935715.249715:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292164224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784935715.249744:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784935715.249833:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292164224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935715.249839:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784935715.249880:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292164224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784935715.250176:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935715.250494:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292164352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784935715.250533:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935715.251628:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292164352 00000100:00100000:0.0:1784935715.251638:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292164352 00000100:00100000:0.0:1784935715.251698:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784935715.251707:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640292164352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784935715.251748:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784935715.251817:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1871640292164352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935715.251824:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784935715.252152:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292164352:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1784935715.764980:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d45adfc-e178-41b7-9e70-f7155e381607 00000001:00080000:2.0:1784935715.764995:0:19518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:3.0:1784935716.141131:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935716.492844:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935716.492951:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273212544 00000100:00100000:1.0:1784935716.492961:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273212544 00000100:00100000:1.0:1784935716.493040:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00100000:1.0:1784935716.493050:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+7:14983:x1871640273212544:12345-192.168.203.28@tcp:41:lfs.0 00000004:00000024:1.0:1784935716.493095:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:2.0:1784935716.493158:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935716.493176:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+7:14983:x1871640273212544:12345-192.168.203.28@tcp:41:lfs.0 Request processed in 126us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935716.493184:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00100000:3.0:1784935716.494704:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935716.495095:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273212672 00000100:00100000:0.0:1784935716.495104:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273212672 00000100:00100000:0.0:1784935716.495267:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00100000:0.0:1784935716.495276:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+6:14983:x1871640273212672:12345-192.168.203.28@tcp:41:lfs.0 00000004:00000024:0.0:1784935716.495311:0:18430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784935716.495403:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+6:14983:x1871640273212672:12345-192.168.203.28@tcp:41:lfs.0 Request processed in 128us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935716.495410:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00080000:2.0:1784935716.495672:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935716.501770:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935716.501886:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273212800 00000100:00100000:0.0:1784935716.501896:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273212800 00000100:00100000:0.0:1784935716.501992:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00100000:0.0:1784935716.502002:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d45adfc-e178-41b7-9e70-f7155e381607+6:14983:x1871640273212800:12345-192.168.203.28@tcp:13:lfs.0 00002000:00000024:0.0:1784935716.502047:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784935716.502130:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d45adfc-e178-41b7-9e70-f7155e381607+6:14983:x1871640273212800:12345-192.168.203.28@tcp:13:lfs.0 Request processed in 129us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935716.502138:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00080000:2.0:1784935716.502357:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784935716.504612:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935716.504695:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273212928 00000100:00100000:3.0:1784935716.504703:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273212928 00000100:00100000:3.0:1784935716.504770:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 12 00000100:00100000:3.0:1784935716.504779:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d45adfc-e178-41b7-9e70-f7155e381607+5:14983:x1871640273212928:12345-192.168.203.28@tcp:13:lfs.0 00002000:00000024:3.0:1784935716.504809:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1784935716.505030:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935716.505152:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d45adfc-e178-41b7-9e70-f7155e381607+5:14983:x1871640273212928:12345-192.168.203.28@tcp:13:lfs.0 Request processed in 374us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935716.505161:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 12 00000100:00100000:3.0:1784935716.693050:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935716.693148:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273213056 00000100:00100000:1.0:1784935716.693158:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273213056 00000100:00100000:1.0:1784935716.693469:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 131 00000100:00100000:1.0:1784935716.693479:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+10:15013:x1871640273213056:12345-192.168.203.28@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784935716.693496:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935716.693513:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d1b8a00/0x857e02f4e0b17bab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313ad6f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.693553:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b8a00/0x857e02f4e0b17bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad6f expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.693565:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d1b8a00/0x857e02f4e0b17bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad6f expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.693575:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8a00, rc 0) 00000100:00100000:1.0:1784935716.693631:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+11:15013:x1871640273213056:12345-192.168.203.28@tcp:101:mount.lustre.0 Request processed in 154us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935716.693638:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 131 00000100:00100000:0.0:1784935716.695557:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935716.698941:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273213184 00000100:00100000:2.0:1784935716.698956:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273213184 00000100:00100000:2.0:1784935716.699027:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 132 00000100:00100000:2.0:1784935716.699042:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+11:15013:x1871640273213184:12345-192.168.203.28@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784935716.699338:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+11:15013:x1871640273213184:12345-192.168.203.28@tcp:501:mount.lustre.0 Request processed in 298us (3790us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935716.699346:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 132 00000100:00100000:3.0:1784935716.702437:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935716.702667:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273213312 00000100:00100000:1.0:1784935716.702677:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273213312 00000100:00100000:1.0:1784935716.702847:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 133 00000100:00100000:1.0:1784935716.702868:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+11:15013:x1871640273213312:12345-192.168.203.28@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784935716.703398:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+11:15013:x1871640273213312:12345-192.168.203.28@tcp:503:mount.lustre.0 Request processed in 540us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935716.703407:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 133 00000100:00100000:3.0:1784935716.707558:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935716.707654:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273213440 00000100:00100000:2.0:1784935716.707673:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273213440 00000100:00100000:2.0:1784935716.707735:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 134 00000100:00100000:2.0:1784935716.707746:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+11:15020:x1871640273213440:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784935716.707964:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+11:15020:x1871640273213440:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 219us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935716.707973:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 134 00000100:00100000:0.0:1784935716.731391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935716.731634:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273213568 00000100:00100000:1.0:1784935716.731651:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273213568 00000100:00100000:1.0:1784935716.731769:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 135 00000100:00100000:1.0:1784935716.731778:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+11:15020:x1871640273213568:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784935716.732063:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+11:15020:x1871640273213568:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 285us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935716.732072:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 135 00000100:00100000:3.0:1784935716.734715:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935716.734779:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273213696 00000100:00100000:0.0:1784935716.734796:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273213696 00000100:00100000:0.0:1784935716.734865:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 136 00000100:00100000:0.0:1784935716.734875:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+11:15020:x1871640273213696:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784935716.735086:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+11:15020:x1871640273213696:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 212us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935716.735094:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 136 00000100:00100000:3.0:1784935716.736590:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935716.736670:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273213824 00000100:00100000:1.0:1784935716.736686:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273213824 00000100:00100000:1.0:1784935716.736775:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 137 00000100:00100000:1.0:1784935716.736784:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+11:15013:x1871640273213824:12345-192.168.203.28@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784935716.736797:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935716.736813:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d1b9000/0x857e02f4e0b17bb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313ada0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.736840:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b9000/0x857e02f4e0b17bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ada0 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.736851:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d1b9000/0x857e02f4e0b17bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ada0 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.736860:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9000, rc 0) 00000100:00100000:1.0:1784935716.736915:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+12:15013:x1871640273213824:12345-192.168.203.28@tcp:101:mount.lustre.0 Request processed in 132us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935716.736921:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 137 00000100:00100000:1.0:1784935716.738704:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935716.738784:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273213952 00000100:00100000:0.0:1784935716.738792:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273213952 00000100:00100000:0.0:1784935716.738841:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 138 00000100:00100000:0.0:1784935716.738850:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44436cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+12:15013:x1871640273213952:12345-192.168.203.28@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784935716.738882:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784935716.738922:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784935716.738947:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784935716.738951:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784935716.738955:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1784935716.738958:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1784935716.741173:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44436cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+12:15013:x1871640273213952:12345-192.168.203.28@tcp:256:mount.lustre.0 Request processed in 2308us (2460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935716.741198:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 138 00000100:00100000:3.0:1784935716.744032:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935716.744312:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273214080 00000100:00100000:1.0:1784935716.744321:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273214080 00000100:00100000:1.0:1784935716.744385:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 139 00000100:00100000:1.0:1784935716.744394:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+12:15013:x1871640273214080:12345-192.168.203.28@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784935716.744411:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935716.744426:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d1b9200/0x857e02f4e0b17bb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313ada7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.744454:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b9200/0x857e02f4e0b17bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ada7 expref: 13 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.744484:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d1b9200/0x857e02f4e0b17bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ada7 expref: 13 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.744494:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9200, rc 0) 00000100:00100000:1.0:1784935716.744545:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+13:15013:x1871640273214080:12345-192.168.203.28@tcp:101:mount.lustre.0 Request processed in 152us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935716.744552:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 139 00000100:00100000:1.0:1784935716.747590:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935716.747740:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273214208 00000100:00100000:0.0:1784935716.747753:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273214208 00000100:00100000:0.0:1784935716.747812:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 140 00000100:00100000:0.0:1784935716.747822:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+13:15013:x1871640273214208:12345-192.168.203.28@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784935716.748017:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+13:15013:x1871640273214208:12345-192.168.203.28@tcp:501:mount.lustre.0 Request processed in 197us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935716.748025:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 140 00000100:00100000:3.0:1784935716.749754:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935716.749855:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273214336 00000100:00100000:2.0:1784935716.749863:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273214336 00000100:00100000:2.0:1784935716.749912:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 141 00000100:00100000:2.0:1784935716.749919:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+13:15013:x1871640273214336:12345-192.168.203.28@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784935716.750078:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+13:15013:x1871640273214336:12345-192.168.203.28@tcp:503:mount.lustre.0 Request processed in 158us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935716.750087:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 141 00000100:00100000:3.0:1784935716.753320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935716.753419:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273214464 00000100:00100000:1.0:1784935716.753428:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273214464 00000100:00100000:1.0:1784935716.753488:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 142 00000100:00100000:1.0:1784935716.753498:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+13:15028:x1871640273214464:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784935716.753675:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+13:15028:x1871640273214464:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 168us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935716.753684:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 142 00000100:00100000:1.0:1784935716.758710:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935716.759329:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273214592 00000100:00100000:0.0:1784935716.759340:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273214592 00000100:00100000:0.0:1784935716.759389:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 143 00000100:00100000:0.0:1784935716.759398:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+13:15028:x1871640273214592:12345-192.168.203.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784935716.759568:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+13:15028:x1871640273214592:12345-192.168.203.28@tcp:502:llog_process_th.0 Request processed in 169us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935716.759578:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 143 00000100:00100000:3.0:1784935716.764141:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935716.764235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935716.764279:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273214720 00000100:00100000:1.0:1784935716.764289:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273214720 00000100:00100000:1.0:1784935716.764333:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273214976 00000100:00100000:1.0:1784935716.764337:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273214976 00000100:00100000:1.0:1784935716.764363:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00100000:1.0:1784935716.764370:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1871640273214720:12345-192.168.203.28@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784935716.764399:0:17199:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 721bb6e9-58e8-4959-869d-7891367d4bab@192.168.203.28@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1784935716.764453:0:17199:0:(genops.c:1406:class_connect()) connect: client 721bb6e9-58e8-4959-869d-7891367d4bab, cookie 0x857e02f4e0b17bc0 00000004:00100000:1.0:1784935716.764477:0:17199:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1784935716.764512:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:3.0:1784935716.764519:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1871640273214976:12345-192.168.203.28@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784935716.764540:0:17198:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 721bb6e9-58e8-4959-869d-7891367d4bab@192.168.203.28@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:3.0:1784935716.764572:0:17198:0:(genops.c:1406:class_connect()) connect: client 721bb6e9-58e8-4959-869d-7891367d4bab, cookie 0x857e02f4e0b17bc7 00000100:00080000:1.0:1784935716.764576:0:17199:0:(import.c:65:import_set_state_nolock()) ffff8d4441b22000 : changing import state from RECOVER to FULL 00000004:00100000:3.0:1784935716.764587:0:17198:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784935716.764635:0:17198:0:(import.c:65:import_set_state_nolock()) ffff8d4570cef000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935716.764642:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:721bb6e9-58e8-4959-869d-7891367d4bab+6:2390:x1871640273214720:12345-192.168.203.28@tcp:38:mount.lustre.0 Request processed in 270us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935716.764651:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00100000:3.0:1784935716.764668:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:721bb6e9-58e8-4959-869d-7891367d4bab+6:2390:x1871640273214976:12345-192.168.203.28@tcp:38:mount.lustre.0 Request processed in 146us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935716.764677:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:3.0:1784935716.776059:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935716.776104:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935716.776157:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273215232 00000100:00100000:0.0:1784935716.776166:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273215232 00000100:00080000:2.0:1784935716.776234:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935716.776249:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273215104 00000100:00100000:0.0:1784935716.776252:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273215104 00000100:00080000:2.0:1784935716.776275:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784935716.776284:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:0.0:1784935716.776574:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:721bb6e9-58e8-4959-869d-7891367d4bab+6:15013:x1871640273215232:12345-192.168.203.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784935716.776617:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784935716.776633:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 19 00000100:00100000:1.0:1784935716.776645:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:721bb6e9-58e8-4959-869d-7891367d4bab+6:0:x1871640273215104:12345-192.168.203.28@tcp:41:mount.lustre.0 00000100:00100000:0.0:1784935716.776690:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:721bb6e9-58e8-4959-869d-7891367d4bab+6:15013:x1871640273215232:12345-192.168.203.28@tcp:41:mount.lustre.0 Request processed in 396us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935716.776698:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:3.0:1784935716.776815:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935716.776851:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273214848 00000100:00100000:0.0:1784935716.776856:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273214848 00000100:00100000:0.0:1784935716.776885:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:0.0:1784935716.776892:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:721bb6e9-58e8-4959-869d-7891367d4bab+6:0:x1871640273214848:12345-192.168.203.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784935716.776911:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000004:00000024:1.0:1784935716.776950:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784935716.777095:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:721bb6e9-58e8-4959-869d-7891367d4bab+6:0:x1871640273214848:12345-192.168.203.28@tcp:41:mount.lustre.0 Request processed in 202us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935716.777102:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:1.0:1784935716.777515:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:721bb6e9-58e8-4959-869d-7891367d4bab+6:0:x1871640273215104:12345-192.168.203.28@tcp:41:mount.lustre.0 Request processed in 871us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935716.777523:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 19 00000100:00100000:1.0:1784935716.782991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935716.783990:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273215360 00000100:00100000:0.0:1784935716.784003:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273215360 00000100:00100000:0.0:1784935716.784076:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:0.0:1784935716.784087:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:721bb6e9-58e8-4959-869d-7891367d4bab+6:15013:x1871640273215360:12345-192.168.203.28@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784935716.784179:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:721bb6e9-58e8-4959-869d-7891367d4bab+6:15013:x1871640273215360:12345-192.168.203.28@tcp:40:mount.lustre.0 Request processed in 94us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935716.784186:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:2.0:1784935716.789822:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935716.789910:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935716.790083:0:17209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273215744 00000100:00100000:0.0:1784935716.790093:0:17209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273215744 00000100:00100000:0.0:1784935716.790158:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 4 00000100:00100000:0.0:1784935716.790168:0:17209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:721bb6e9-58e8-4959-869d-7891367d4bab+6:15013:x1871640273215744:12345-192.168.203.28@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784935716.790266:0:17209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:721bb6e9-58e8-4959-869d-7891367d4bab+6:15013:x1871640273215744:12345-192.168.203.28@tcp:900:mount.lustre.0 Request processed in 100us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935716.790274:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 4 00000100:00100000:1.0:1784935716.790407:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273215488 00000100:00100000:1.0:1784935716.790412:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273215488 00000100:00100000:1.0:1784935716.790476:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:1.0:1784935716.790482:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1871640273215488:12345-192.168.203.28@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784935716.790508:0:19236:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 721bb6e9-58e8-4959-869d-7891367d4bab@192.168.203.28@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1784935716.790540:0:19236:0:(genops.c:1406:class_connect()) connect: client 721bb6e9-58e8-4959-869d-7891367d4bab, cookie 0x857e02f4e0b17bce 00002000:00100000:1.0:1784935716.790552:0:19236:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 721bb6e9-58e8-4959-869d-7891367d4bab/ffff8d4441b27000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784935716.790561:0:19236:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784935716.790637:0:19236:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784935716.790663:0:19236:0:(import.c:65:import_set_state_nolock()) ffff8d45455de800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784935716.790691:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:721bb6e9-58e8-4959-869d-7891367d4bab+6:2390:x1871640273215488:12345-192.168.203.28@tcp:8:mount.lustre.0 Request processed in 208us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935716.790698:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:3.0:1784935716.790962:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935716.791036:0:18705:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273215616 00000100:00100000:0.0:1784935716.791041:0:18705:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273215616 00000100:00100000:0.0:1784935716.791072:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:0.0:1784935716.791078:0:18705:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1871640273215616:12345-192.168.203.28@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784935716.791103:0:18705:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 721bb6e9-58e8-4959-869d-7891367d4bab@192.168.203.28@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1784935716.791120:0:18705:0:(genops.c:1406:class_connect()) connect: client 721bb6e9-58e8-4959-869d-7891367d4bab, cookie 0x857e02f4e0b17bd5 00002000:00100000:0.0:1784935716.791126:0:18705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 721bb6e9-58e8-4959-869d-7891367d4bab/ffff8d4549f2d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784935716.791132:0:18705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784935716.791190:0:18705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784935716.791205:0:18705:0:(import.c:65:import_set_state_nolock()) ffff8d4549f28000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784935716.791238:0:18705:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:721bb6e9-58e8-4959-869d-7891367d4bab+6:2390:x1871640273215616:12345-192.168.203.28@tcp:8:mount.lustre.0 Request processed in 158us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935716.791244:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:1.0:1784935716.792304:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935716.797873:0:17201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273215872 00000100:00100000:3.0:1784935716.797889:0:17201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273215872 00000100:00100000:3.0:1784935716.797994:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 1 00000100:00100000:3.0:1784935716.798006:0:17201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:721bb6e9-58e8-4959-869d-7891367d4bab+6:15013:x1871640273215872:12345-192.168.203.28@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784935716.798096:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784935716.798194:0:17201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:721bb6e9-58e8-4959-869d-7891367d4bab+6:15013:x1871640273215872:12345-192.168.203.28@tcp:33:mount.lustre.0 Request processed in 191us (5894us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935716.798202:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 1 00000100:00100000:3.0:1784935716.922377:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935716.922842:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273216000 00000100:00100000:1.0:1784935716.922852:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273216000 00000100:00100000:1.0:1784935716.922912:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 22 00000100:00100000:1.0:1784935716.922923:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:721bb6e9-58e8-4959-869d-7891367d4bab+6:15051:x1871640273216000:12345-192.168.203.28@tcp:101:mkdir.0 00010000:00010000:1.0:1784935716.922968:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935716.922991:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17bdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313add8 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.923048:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.923059:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.923069:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935716.923102:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784935716.923105:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935716.923119:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.923137:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17bdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313add8 expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.923151:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313add8 expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935716.923156:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4442a6bb00) 00010000:00010000:1.0:1784935716.923158:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784935716.923172:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8e00, rc 0) 00000100:00100000:1.0:1784935716.923241:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:721bb6e9-58e8-4959-869d-7891367d4bab+7:15051:x1871640273216000:12345-192.168.203.28@tcp:101:mkdir.0 Request processed in 319us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935716.923248:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 22 00010000:00010000:3.0:1784935717.166841:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935717.806123:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292164480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935717.806216:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935717.806301:0:18708:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292164480 00000100:00100000:1.0:1784935717.806309:0:18708:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292164480 00000100:00100000:1.0:1784935717.806383:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784935717.806392:0:18708:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292164480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784935717.806421:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784935717.806467:0:18708:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292164480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935717.806475:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784935717.806520:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292164480:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784935717.806571:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784935718.189986:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935719.213669:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935719.342137:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292164608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935719.342234:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935719.355160:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292164608 00000100:00100000:0.0:1784935719.355450:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292164608 00000100:00100000:0.0:1784935719.355503:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784935719.355513:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292164608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935719.355545:0:17938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784935719.355618:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292164608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (13384us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935719.355626:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784935719.355741:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292164608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935719.357725:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292164736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784935719.357785:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935719.359218:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292164736 00000100:00100000:3.0:1784935719.359229:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292164736 00000100:00100000:3.0:1784935719.359512:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784935719.359523:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292164736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784935719.359556:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784935719.359637:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292164736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935719.359645:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784935719.359728:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292164736:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1784935719.697475:0:20075:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1784935719.868189:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292164864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784935719.868291:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935719.868351:0:18708:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292164864 00000100:00100000:1.0:1784935719.868358:0:18708:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292164864 00000100:00100000:1.0:1784935719.868414:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784935719.868422:0:18708:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292164864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784935719.868452:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784935719.868493:0:18708:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292164864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935719.868499:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1784935719.868517:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935719.868551:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292164864:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1784935719.870293:0:17930:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 721bb6e9-58e8-4959-869d-7891367d4bab 00000001:00100000:0.0:1784935719.870304:0:17930:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5d45adfc-e178-41b7-9e70-f7155e381607 00000001:00100000:2.0:1784935719.876576:0:18700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 721bb6e9-58e8-4959-869d-7891367d4bab 00000001:00100000:2.0:1784935719.876586:0:18700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d45adfc-e178-41b7-9e70-f7155e381607 00000001:00100000:3.0:1784935719.877920:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 721bb6e9-58e8-4959-869d-7891367d4bab 00000001:00100000:3.0:1784935719.877957:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d45adfc-e178-41b7-9e70-f7155e381607 00010000:00010000:3.0:1784935720.237092:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935720.365282:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935720.365305:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292164992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935720.365368:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935720.365421:0:18708:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292164992 00000100:00100000:3.0:1784935720.365428:0:18708:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292164992 00000100:00100000:3.0:1784935720.365476:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784935720.365484:0:18708:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292164992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784935720.365510:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784935720.365549:0:18708:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292164992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935720.365556:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1784935720.365575:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935720.365605:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1784935720.365626:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292164992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935720.365825:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292165120:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.365859:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935720.365881:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292165632:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.365905:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935720.365923:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292166144:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.365963:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935720.365982:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784935720.365988:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292165248:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366011:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935720.366028:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292165760:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366047:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935720.366064:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292166272:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366084:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935720.366109:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292165632 00000100:00100000:0.0:1784935720.366113:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292165632 00000100:00100000:0.0:1784935720.366147:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292165760 00000100:00100000:0.0:1784935720.366151:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292165760 00000100:00100000:0.0:1784935720.366171:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784935720.366177:0:18703:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292165632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366230:0:18703:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292165632:12345-0@lo:400:kworker.0 Request processed in 53us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935720.366237:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784935720.366250:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784935720.366256:0:18703:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292165760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366282:0:18703:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292165760:12345-0@lo:400:kworker.0 Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935720.366302:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784935720.366321:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292166144 00000100:00100000:0.0:1784935720.366325:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292166144 00000100:00100000:0.0:1784935720.366348:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292166272 00000100:00100000:0.0:1784935720.366351:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292166272 00000100:00100000:0.0:1784935720.366370:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784935720.366377:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292166144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366408:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871640292166144:12345-0@lo:400:kworker.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935720.366414:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784935720.366425:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784935720.366430:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292166272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366471:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871640292166272:12345-0@lo:400:kworker.0 Request processed in 41us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935720.366477:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784935720.366494:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292165248 00000100:00100000:0.0:1784935720.366498:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292165248 00000100:00100000:0.0:1784935720.366522:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784935720.366529:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292165248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366563:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292165248:12345-0@lo:400:kworker.0 Request processed in 34us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935720.366569:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784935720.366590:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292165504:0@lo:400:kworker.0 00000100:00080000:0.0:1784935720.366605:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784935720.366610:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935720.366614:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784935720.366617:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935720.366627:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935720.366630:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292165376:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366671:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935720.366672:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292166016:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366694:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292165888:0@lo:400:kworker.0 00000100:00100000:1.0:1784935720.366706:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935720.366727:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935720.366749:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292166400:0@lo:400:kworker.0 00000100:00100000:1.0:1784935720.366754:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292165120 00000100:00100000:1.0:1784935720.366760:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292165120 00000100:00100000:0.0:1784935720.366771:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935720.366799:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784935720.366801:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292165376 00000100:00100000:0.0:1784935720.366806:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292165376 00000100:00100000:1.0:1784935720.366810:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3649:x1871640292165120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366827:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292166016 00000100:00100000:0.0:1784935720.366831:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292166016 00000100:00100000:1.0:1784935720.366852:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3649:x1871640292165120:12345-0@lo:400:kworker.0 Request processed in 44us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935720.366853:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292165888 00000100:00100000:0.0:1784935720.366858:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292165888 00000100:00100000:1.0:1784935720.366864:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784935720.366871:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292166400 00000100:00100000:0.0:1784935720.366874:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292166400 00000100:00100000:0.0:1784935720.366894:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784935720.366902:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292165376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935720.366910:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292165504 00000100:00100000:1.0:1784935720.366916:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292165504 00000100:00100000:1.0:1784935720.366962:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784935720.366964:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1871640292165376:12345-0@lo:400:kworker.0 Request processed in 63us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935720.366972:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292165504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.366974:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784935720.366992:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784935720.367001:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292166016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935720.367017:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292165504:12345-0@lo:400:kworker.0 Request processed in 47us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935720.367026:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784935720.367038:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1871640292166016:12345-0@lo:400:kworker.0 Request processed in 39us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935720.367045:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784935720.367062:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784935720.367071:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292165888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935720.367116:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1871640292165888:12345-0@lo:400:kworker.0 Request processed in 47us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935720.367290:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784935720.367298:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292166400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.367323:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1871640292166400:12345-0@lo:400:kworker.0 Request processed in 27us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935720.367337:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1784935720.367351:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784935720.367354:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784935720.367376:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292165248:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.367385:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292165760:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.367393:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1871640292166272:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.367400:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3649:1871640292165120:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.367408:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292165632:0@lo:400:kworker.0 00010000:00080000:0.0:1784935720.367419:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb6d80 x1871640292166144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935720.367428:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1871640292166144:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.367456:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1871640292165376:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.367465:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1871640292165888:0@lo:400:kworker.0 00010000:00080000:0.0:1784935720.367473:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4566eb6680 x1871640292166400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784935720.367480:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1871640292166400:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.367490:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784935720.367495:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292166528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935720.367516:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935720.367567:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292165504:0@lo:400:kworker.0 00000100:00100000:0.0:1784935720.367576:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1871640292166016:0@lo:400:kworker.0 00000100:00100000:3.0:1784935720.369077:0:18708:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292166528 00000100:00100000:3.0:1784935720.369089:0:18708:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292166528 00000100:00100000:3.0:1784935720.369140:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784935720.369148:0:18708:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292166528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784935720.369182:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784935720.369261:0:18708:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1871640292166528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935720.369268:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784935720.369317:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1871640292166528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784935720.369470:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1784935721.263083:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784935721.841110:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784935722.163643:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935722.164280:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935722.164308:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935722.164339:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935722.164357:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935722.164376:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935722.164395:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935722.164413:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935722.164436:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935722.164465:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273216384 00000100:00100000:2.0:1784935722.164474:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273216384 00000100:00100000:2.0:1784935722.164522:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273216896 00000100:00100000:2.0:1784935722.164525:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273216896 00000100:00100000:2.0:1784935722.164538:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273216256 00000100:00100000:2.0:1784935722.164541:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273216256 00000100:00100000:2.0:1784935722.164553:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273216768 00000100:00100000:2.0:1784935722.164555:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273216768 00000100:00100000:2.0:1784935722.164571:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 48 00000100:00100000:2.0:1784935722.164581:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+5:2391:x1871640273216384:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935722.164668:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+5:2391:x1871640273216384:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 89us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935722.164676:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 48 00000100:00100000:2.0:1784935722.164714:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 49 00000100:00100000:2.0:1784935722.164722:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:721bb6e9-58e8-4959-869d-7891367d4bab+5:2391:x1871640273216896:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935722.164749:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:721bb6e9-58e8-4959-869d-7891367d4bab+5:2391:x1871640273216896:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 29us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935722.164755:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 49 00000100:00100000:2.0:1784935722.164766:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:2.0:1784935722.164773:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+6:2391:x1871640273216256:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935722.164795:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+6:2391:x1871640273216256:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 23us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935722.164801:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:2.0:1784935722.164811:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00100000:2.0:1784935722.164817:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:721bb6e9-58e8-4959-869d-7891367d4bab+6:2391:x1871640273216768:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935722.164838:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:721bb6e9-58e8-4959-869d-7891367d4bab+6:2391:x1871640273216768:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 21us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935722.164844:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00100000:2.0:1784935722.164865:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273216640 00000100:00100000:2.0:1784935722.164869:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273216640 00000100:00100000:2.0:1784935722.164888:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273217152 00000100:00100000:2.0:1784935722.164891:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273217152 00000100:00100000:2.0:1784935722.164902:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273216512 00000100:00100000:2.0:1784935722.164904:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273216512 00000100:00100000:2.0:1784935722.164915:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273217024 00000100:00100000:2.0:1784935722.164917:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273217024 00000100:00100000:2.0:1784935722.164950:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 12 00000100:00100000:2.0:1784935722.164956:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45adfc-e178-41b7-9e70-f7155e381607+5:2391:x1871640273216640:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935722.164980:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45adfc-e178-41b7-9e70-f7155e381607+5:2391:x1871640273216640:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 24us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935722.164992:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 12 00000100:00100000:2.0:1784935722.165005:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 13 00000100:00100000:2.0:1784935722.165011:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:721bb6e9-58e8-4959-869d-7891367d4bab+6:2391:x1871640273217152:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935722.165034:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:721bb6e9-58e8-4959-869d-7891367d4bab+6:2391:x1871640273217152:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 24us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935722.165040:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 13 00000100:00100000:2.0:1784935722.165050:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00100000:2.0:1784935722.165056:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45adfc-e178-41b7-9e70-f7155e381607+5:2391:x1871640273216512:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935722.165076:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45adfc-e178-41b7-9e70-f7155e381607+5:2391:x1871640273216512:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 20us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935722.165082:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00100000:2.0:1784935722.165092:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00100000:2.0:1784935722.165099:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:721bb6e9-58e8-4959-869d-7891367d4bab+5:2391:x1871640273217024:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935722.165118:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:721bb6e9-58e8-4959-869d-7891367d4bab+5:2391:x1871640273217024:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 20us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935722.165124:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00100000:0.0:1784935722.167408:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273216128 00000100:00100000:0.0:1784935722.167420:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273216128 00000100:00100000:0.0:1784935722.167472:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 145 00000100:00100000:0.0:1784935722.167481:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+13:2391:x1871640273216128:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:0.0:1784935722.167547:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+13:2391:x1871640273216128:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 68us (3914us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.167551:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 145 00000100:00080000:0.0:1784935722.167579:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784935722.167583:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784935722.167586:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784935722.167588:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784935722.289446:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935722.925088:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935722.925111:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292166656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935722.925197:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935722.925274:0:18708:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292166656 00000100:00100000:0.0:1784935722.925281:0:18708:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292166656 00000100:00100000:0.0:1784935722.925343:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784935722.925351:0:18708:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292166656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784935722.925379:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784935722.925429:0:18708:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292166656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.925437:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784935722.925494:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292166656:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784935722.925503:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1784935722.927363:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 721bb6e9-58e8-4959-869d-7891367d4bab 00000020:00000080:2.0:1784935722.963423:0:20223:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffaef7cf90 20000000:00000080:2.0:1784935722.963439:0:20223:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d4573150c00 uarg=0000000000000000 20000000:01000000:2.0:1784935722.963481:0:20223:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784935722.963487:0:20223:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784935722.963496:0:20223:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784935722.964291:0:20224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1784935722.964373:0:20223:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784935722.974762:0:20223:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784935722.974803:0:20223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975447:0:20223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b1787f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17878 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975457:0:20223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1788d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17886 expref: 23 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975463:0:20223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d4554020200/0x857e02f4e0b178cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b178c5 expref: 23 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975470:0:20223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d457d301600/0x857e02f4e0b17a2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17a23 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975478:0:20223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b17b7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad37 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975486:0:20223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d457d1b9200/0x857e02f4e0b17bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ada7 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975494:0:20223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975537:0:20223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d457d1b9200/0x857e02f4e0b17bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ada7 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975553:0:20223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d457d1b9200/0x857e02f4e0b17bb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ada7 expref: 12 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935722.975570:0:20223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443665500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292166784:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935722.975707:0:20223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b17b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad37 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975724:0:20223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b17b7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad37 expref: 12 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935722.975733:0:20223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443666d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292166912:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935722.975777:0:20223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d457d301600/0x857e02f4e0b17a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b17a23 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975785:0:20223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d457d301600/0x857e02f4e0b17a2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b17a23 expref: 23 pid: 17192 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935722.975794:0:20223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443667800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292167040:0@lo:104: 00000100:00100000:1.0:1784935722.975846:0:20223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784935722.975888:0:20223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4554020200/0x857e02f4e0b178cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b178c5 expref: 23 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.975897:0:20223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4554020200/0x857e02f4e0b178cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b178c5 expref: 23 pid: 17190 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935722.975905:0:20223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d6d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292167168:0@lo:104: 00000100:00100000:1.0:1784935722.975925:0:20223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784935722.976197:0:20223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1788d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b17886 expref: 23 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.976206:0:20223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1788d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b17886 expref: 23 pid: 17190 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935722.976215:0:20223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292167296:0@lo:104: 00000100:00100000:1.0:1784935722.976238:0:20223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784935722.976267:0:20223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b1787f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x857e02f4e0b17878 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.976288:0:20223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b1787f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x857e02f4e0b17878 expref: 23 pid: 17192 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935722.976295:0:20223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292167424:0@lo:104: 00000100:00100000:1.0:1784935722.976316:0:20223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935722.976325:0:20223:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1784935722.976591:0:17181:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292167040 00000100:00100000:0.0:1784935722.976599:0:17181:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292167040 00000100:00100000:0.0:1784935722.976635:0:17181:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292167168 00000100:00100000:0.0:1784935722.976639:0:17181:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292167168 00000100:00100000:0.0:1784935722.976649:0:17181:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292167296 00000100:00100000:0.0:1784935722.976651:0:17181:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292167296 00000100:00100000:0.0:1784935722.976661:0:17181:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292167424 00000100:00100000:0.0:1784935722.976663:0:17181:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292167424 00000100:00100000:0.0:1784935722.976675:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784935722.976684:0:17181:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+6:20223:x1871640292167040:12345-0@lo:104: 00010000:00010000:0.0:1784935722.976704:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.976781:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784935722.976787:0:17181:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+6:20223:x1871640292167040:12345-0@lo:104: Request processed in 105us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.976794:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784935722.976811:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784935722.976816:0:17181:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+5:20223:x1871640292167168:12345-0@lo:104: 00010000:00010000:0.0:1784935722.976823:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.976868:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784935722.976873:0:17181:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+5:20223:x1871640292167168:12345-0@lo:104: Request processed in 58us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.976879:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784935722.976891:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784935722.976896:0:17181:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+4:20223:x1871640292167296:12345-0@lo:104: 00010000:00010000:0.0:1784935722.976903:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977019:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784935722.977025:0:17181:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+4:20223:x1871640292167296:12345-0@lo:104: Request processed in 130us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.977031:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784935722.977042:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784935722.977047:0:17181:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:20223:x1871640292167424:12345-0@lo:104: 00010000:00010000:0.0:1784935722.977060:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977088:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1784935722.977095:0:17181:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+3:20223:x1871640292167424:12345-0@lo:104: Request processed in 46us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.977101:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1784935722.977124:0:19714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1784935722.977129:0:20223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443667800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292167040:0@lo:104: 00010000:00010000:0.0:1784935722.977130:0:19714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977143:0:19714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528800 already unused, calling callback (ffffffffc12b4c20) 00000100:00100000:2.0:1784935722.977147:0:20223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d6d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292167168:0@lo:104: 10000000:00010000:0.0:1784935722.977150:0:19714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935722.977160:0:20223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292167296:0@lo:104: 00010000:00010000:0.0:1784935722.977161:0:19714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935722.977170:0:20223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292167424:0@lo:104: 10000000:00010000:0.0:1784935722.977192:0:19714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935722.977198:0:19714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784935722.977234:0:19714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977242:0:19714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935722.977263:0:19714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977269:0:19714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4541528800/0x857e02f4e0b17a23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b17a2a expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977353:0:19714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784935722.977356:0:19714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977362:0:19714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443200800 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935722.977365:0:19714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977372:0:19714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935722.977378:0:19714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935722.977384:0:19714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784935722.977398:0:19714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977404:0:19714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935722.977419:0:19714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977426:0:19714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4443200800/0x857e02f4e0b178c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b178cc expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977436:0:19714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784935722.977439:0:19714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977455:0:19714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4443201c00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935722.977458:0:19714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977465:0:19714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935722.977472:0:19714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935722.977477:0:19714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784935722.977489:0:19714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977494:0:19714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935722.977500:0:19714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977505:0:19714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d4443201c00/0x857e02f4e0b17886 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1788d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977514:0:19714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784935722.977516:0:19714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977521:0:19714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8c00 already unused, calling callback (ffffffffc12b4c20) 10000000:00010000:0.0:1784935722.977523:0:19714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977539:0:19714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784935722.977544:0:19714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935722.977549:0:19714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784935722.977560:0:19714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977565:0:19714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784935722.977571:0:19714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977578:0:19714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8c00/0x857e02f4e0b17878 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x857e02f4e0b1787f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.977591:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935722.977592:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935722.977594:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935722.977601:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784935722.977606:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935722.977616:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292167552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935722.977647:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935722.977680:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784935722.977686:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292167936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935722.977705:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935722.977729:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292167680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935722.977757:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935722.977775:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784935722.977780:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292167808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935722.977797:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935722.977821:0:17184:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292167552 00000100:00100000:0.0:1784935722.977825:0:17184:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292167552 00010000:00010000:0.0:1784935722.977847:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d457d301600/0x857e02f4e0b17a2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17a23 expref: 24 pid: 17192 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935722.977863:0:17184:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292167936 00000100:00100000:0.0:1784935722.977866:0:17184:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292167936 00010000:00010000:0.0:1784935722.977876:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b1787f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17878 expref: 25 pid: 17192 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935722.977886:0:17184:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292167680 00000100:00100000:0.0:1784935722.977888:0:17184:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292167680 00010000:00010000:0.0:1784935722.977897:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4554020200/0x857e02f4e0b178cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b178c5 expref: 26 pid: 17190 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935722.977907:0:17184:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292167808 00000100:00100000:0.0:1784935722.977909:0:17184:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292167808 00010000:00010000:0.0:1784935722.977918:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1788d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17886 expref: 27 pid: 17190 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935722.978147:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784935722.978156:0:17184:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+27:3650:x1871640292167552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784935722.978228:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935722.978235:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d457d301600/0x857e02f4e0b17a2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17a23 expref: 27 pid: 17192 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978255:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d457d301600/0x857e02f4e0b17a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b17a23 expref: 27 pid: 17192 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978269:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d301600/0x857e02f4e0b17a2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b17a23 expref: 27 pid: 17192 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978353:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935722.978388:0:17184:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+26:3650:x1871640292167552:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.978395:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784935722.978409:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784935722.978415:0:17184:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+25:3650:x1871640292167936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784935722.978423:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935722.978428:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b1787f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17878 expref: 25 pid: 17192 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978436:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b1787f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b17878 expref: 25 pid: 17192 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978445:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b1787f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b17878 expref: 25 pid: 17192 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978454:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935722.978473:0:17184:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3650:x1871640292167936:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.978480:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784935722.978490:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784935722.978496:0:17184:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:3651:x1871640292167680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784935722.978508:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935722.978513:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4554020200/0x857e02f4e0b178cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b178c5 expref: 23 pid: 17190 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978520:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4554020200/0x857e02f4e0b178cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b178c5 expref: 23 pid: 17190 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978529:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4554020200/0x857e02f4e0b178cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b178c5 expref: 23 pid: 17190 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978537:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935722.978560:0:17184:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:3651:x1871640292167680:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.978566:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784935722.978577:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784935722.978582:0:17184:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:3651:x1871640292167808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784935722.978589:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935722.978593:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1788d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x857e02f4e0b17886 expref: 21 pid: 17190 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978601:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1788d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x857e02f4e0b17886 expref: 21 pid: 17190 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978611:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d4443200c00/0x857e02f4e0b1788d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x857e02f4e0b17886 expref: 21 pid: 17190 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.978619:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935722.978638:0:17184:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:3651:x1871640292167808:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.978651:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784935722.978701:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292167808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935722.978709:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3651:1871640292167680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935722.978736:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292167936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784935722.978743:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3650:1871640292167552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784935722.982251:0:20223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443665500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292166784:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935722.982261:0:20223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443666d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20223:1871640292166912:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935722.982288:0:20223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935722.985192:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935722.985309:0:17184:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273217280 00000100:00100000:0.0:1784935722.985319:0:17184:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273217280 00010000:00010000:0.0:1784935722.985355:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d457d1b9200/0x857e02f4e0b17bb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ada7 expref: 13 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935722.985424:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 13 00000100:00100000:0.0:1784935722.985515:0:17184:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45705ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07085f05-e0be-469f-87e0-210ab47bba20+13:2392:x1871640273217280:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935722.985532:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935722.985539:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d457d1b9200/0x857e02f4e0b17bb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ada7 expref: 13 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.985551:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d457d1b9200/0x857e02f4e0b17bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ada7 expref: 13 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.985570:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d1b9200/0x857e02f4e0b17bb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ada7 expref: 13 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.985583:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935722.985679:0:17184:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45705ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07085f05-e0be-469f-87e0-210ab47bba20+12:2392:x1871640273217280:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 246us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.985702:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 13 00000100:00100000:2.0:1784935722.987554:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935722.987603:0:17183:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273217408 00000100:00100000:0.0:1784935722.987609:0:17183:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273217408 00010000:00010000:0.0:1784935722.987634:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b17b7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad37 expref: 12 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935722.987660:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 14 00000100:00100000:0.0:1784935722.987665:0:17183:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07085f05-e0be-469f-87e0-210ab47bba20+12:2391:x1871640273217408:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935722.987675:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935722.987678:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b17b7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad37 expref: 12 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987685:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b17b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad37 expref: 12 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987696:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d1b8400/0x857e02f4e0b17b7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad37 expref: 12 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987708:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987714:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987725:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987729:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987746:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987750:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987754:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9e00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935722.987757:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987762:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987778:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935722.987785:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935722.987826:0:17183:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07085f05-e0be-469f-87e0-210ab47bba20+11:2391:x1871640273217408:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 161us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935722.987830:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 14 00010000:00010000:1.0:1784935722.987894:0:20223:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.987899:0:20223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935722.987903:0:20223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d457d1b9e00/0x857e02f4e0b17bea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935723.313856:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784935724.339048:0:17194:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784935724.339057:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457b962800 from 13 10000000:01000000:0.0:1784935724.339063:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784935724.339118:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b17bf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.339131:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b17bf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.339175:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b17bf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935724.339204:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.339282:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935724.339324:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454913fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784935724.339344:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292168064 00000100:00100000:0.0:1784935724.339350:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292168064 00000100:00100000:0.0:1784935724.339393:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784935724.339401:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+20:17194:x1871640292168064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935724.339416:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935724.339428:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443698000/0x857e02f4e0b17bf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17bf1 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.339462:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443698000/0x857e02f4e0b17bf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17bf1 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.339473:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443698000/0x857e02f4e0b17bf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17bf1 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.339481:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698000, rc 0) 00000100:00100000:0.0:1784935724.339517:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:17194:x1871640292168064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935724.339523:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784935724.339568:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935724.339582:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b17bf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17bf8 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.339595:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b17bf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17bf8 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935724.339646:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.339673:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935724.339686:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454913fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784935724.339700:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292168192 00000100:00100000:0.0:1784935724.339703:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292168192 00000100:00100000:0.0:1784935724.339725:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784935724.339731:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:17194:x1871640292168192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.339833:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:17194:x1871640292168192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935724.339840:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784935724.339870:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.339894:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.339947:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935724.339966:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454913fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784935724.339976:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292168320 00000100:00100000:0.0:1784935724.339979:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292168320 00000100:00100000:0.0:1784935724.339998:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784935724.340003:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:17194:x1871640292168320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.340073:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:17194:x1871640292168320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935724.340080:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784935724.340117:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784935724.340794:0:20286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1784935724.340845:0:17194:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1784935724.340862:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784935724.340870:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b17bf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17bf8 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.340881:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443698600/0x857e02f4e0b17bf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17bf8 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935724.340890:0:17194:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784935724.340892:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d457d1b3800 from 13 10000000:01000000:0.0:1784935724.340894:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784935724.340914:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443699a00/0x857e02f4e0b17bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.340923:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4443699a00/0x857e02f4e0b17bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.340964:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4443699a00/0x857e02f4e0b17bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935724.340981:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.341018:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935724.341041:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454913fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935724.341062:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292168448 00000100:00100000:0.0:1784935724.341067:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292168448 00000100:00100000:0.0:1784935724.341098:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00010000:00010000:3.0:1784935724.342256:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784935724.345814:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+21:17194:x1871640292168448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935724.345916:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935724.345953:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b17c06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17bff expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.345982:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b17c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17bff expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.345993:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4443698c00/0x857e02f4e0b17c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17bff expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.346002:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4443698c00, rc 0) 00000100:00100000:0.0:1784935724.346074:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:17194:x1871640292168448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4969us (5055us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935724.346082:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784935724.357028:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935724.357057:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4443699a00/0x857e02f4e0b17bff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17c06 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.357069:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4443699a00/0x857e02f4e0b17bff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17c06 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935724.357287:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.357343:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935724.357379:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454913fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935724.357399:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292168576 00000100:00100000:0.0:1784935724.357405:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292168576 00000100:00100000:0.0:1784935724.357439:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784935724.357447:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:17194:x1871640292168576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.357570:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:17194:x1871640292168576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935724.357578:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784935724.357612:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.357639:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.357678:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935724.357691:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454913fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784935724.357703:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292168704 00000100:00100000:0.0:1784935724.357707:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292168704 00000100:00100000:0.0:1784935724.357728:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784935724.357734:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:17194:x1871640292168704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.357806:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:17194:x1871640292168704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935724.357813:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784935724.358090:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784935724.360883:0:20288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1784935724.361021:0:17194:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1784935724.361040:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784935724.361051:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4443699a00/0x857e02f4e0b17bff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17c06 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.361061:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4443699a00/0x857e02f4e0b17bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17c06 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784935724.361070:0:17194:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784935724.361079:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4443d3b800 from 13 10000000:01000000:0.0:1784935724.361082:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784935724.361115:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b17c0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.361122:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b17c0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.361131:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b17c0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935724.361162:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.361239:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935724.361274:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454913f180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935724.361292:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292168832 00000100:00100000:0.0:1784935724.361297:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292168832 00000100:00100000:0.0:1784935724.361333:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784935724.361340:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+22:17194:x1871640292168832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935724.361351:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935724.361360:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b17c14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17c0d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.361379:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b17c14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17c0d expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.361390:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554020e00/0x857e02f4e0b17c14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17c0d expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.361398:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554020e00, rc 0) 00000100:00100000:0.0:1784935724.361432:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:17194:x1871640292168832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935724.361444:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784935724.361499:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935724.361512:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b17c0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17c14 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.361521:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b17c0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17c14 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935724.361566:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.361591:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935724.361604:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454913f180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935724.361613:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292168960 00000100:00100000:0.0:1784935724.361615:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292168960 00000100:00100000:0.0:1784935724.361630:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784935724.361633:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:17194:x1871640292168960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.361709:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:17194:x1871640292168960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935724.361714:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784935724.361733:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292168960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.361750:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292169088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.361775:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935724.361784:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d454913f180 going to sleep for 11 seconds 00000100:00100000:0.0:1784935724.361791:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292169088 00000100:00100000:0.0:1784935724.361793:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292169088 00000100:00100000:0.0:1784935724.361807:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784935724.361816:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:17194:x1871640292169088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784935724.361886:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:17194:x1871640292169088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935724.361892:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784935724.361925:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292169088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784935724.367160:0:20289:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784935724.367236:0:17194:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784935724.367263:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784935724.367275:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b17c0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17c14 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935724.367287:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d4554020200/0x857e02f4e0b17c0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17c14 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784935724.367309:0:17194:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784935724.367311:0:17194:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d4443cc0000 from 13 10000000:01000000:1.0:1784935724.367315:0:17194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784935724.367349:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17c1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935724.367358:0:17194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17c1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935724.367369:0:17194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17c1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935724.367395:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292169216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784935724.367460:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935724.367500:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1784935724.369833:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292169216 00000100:00100000:1.0:1784935724.369846:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292169216 00000100:00100000:1.0:1784935724.369897:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784935724.369907:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+23:17194:x1871640292169216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935724.369940:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935724.369958:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d457d1b9600/0x857e02f4e0b17c22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857e02f4e0b17c1b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935724.369986:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d457d1b9600/0x857e02f4e0b17c22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x857e02f4e0b17c1b expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935724.369997:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d457d1b9600/0x857e02f4e0b17c22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x857e02f4e0b17c1b expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935724.370019:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9600, rc 0) 00000100:00100000:1.0:1784935724.370096:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:17194:x1871640292169216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (2635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935724.370103:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784935724.370428:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292169216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784935724.370446:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17c1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17c22 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935724.370456:0:17194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17c1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x857e02f4e0b17c22 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935724.370527:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292169344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935724.370560:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935724.370588:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1784935724.370603:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292169344 00000100:00100000:1.0:1784935724.370606:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292169344 00000100:00100000:1.0:1784935724.370630:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784935724.370636:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:17194:x1871640292169344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935724.370745:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:17194:x1871640292169344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935724.370751:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784935724.370777:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292169344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935724.370802:0:17194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292169472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784935724.370842:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935724.371602:0:17194:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1784935724.372764:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292169472 00000100:00100000:2.0:1784935724.372775:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292169472 00000100:00100000:2.0:1784935724.372865:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784935724.372875:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4549fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:17194:x1871640292169472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935724.373037:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4549fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:17194:x1871640292169472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935724.373043:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784935724.373126:0:17194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c8b4eee-3769-4cc8-9dd4-4824356c9813:17194:1871640292169472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784935724.381674:0:20290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784935724.389390:0:17194:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784935724.389428:0:17194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784935724.389439:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17c1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17c22 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935724.389452:0:17194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.128@tcp lock: ffff8d457d1b8600/0x857e02f4e0b17c1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x857e02f4e0b17c22 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935724.461307:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784935724.461330:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292169600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784935724.461399:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935724.461436:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292169600 00000100:00100000:0.0:1784935724.461445:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292169600 00000100:00100000:0.0:1784935724.461499:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784935724.461507:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292169600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935724.461540:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784935724.461598:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292169600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935724.461606:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784935724.461761:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292169600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784935724.464785:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784935724.464808:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292169728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784935724.464875:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935724.464992:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292169728 00000100:00100000:2.0:1784935724.465000:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292169728 00000100:00100000:2.0:1784935724.465057:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784935724.465066:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292169728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784935724.465120:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784935724.465184:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292169728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935724.465191:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784935724.465315:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292169728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784935724.778622:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935724.781095:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273217536 00000100:00100000:0.0:1784935724.781109:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273217536 00000100:00100000:0.0:1784935724.781182:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 158 00000100:00100000:0.0:1784935724.781192:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4561d1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+11:14899:x1871640273217536:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784935724.781208:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935724.781225:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4554021600/0x857e02f4e0b17c29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313addf expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.781251:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4554021600/0x857e02f4e0b17c29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313addf expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.781263:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4554021600/0x857e02f4e0b17c29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313addf expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935724.781280:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021600, rc 0) 00000100:00100000:0.0:1784935724.781338:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4561d1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+12:14899:x1871640273217536:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 Request processed in 147us (2726us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935724.781344:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 158 00000100:00100000:3.0:1784935724.804066:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935724.809011:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273217664 00000100:00100000:3.0:1784935724.809026:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273217664 00000100:00100000:3.0:1784935724.809085:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 159 00000100:00100000:3.0:1784935724.809095:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4561d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+12:14899:x1871640273217664:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784935724.809573:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4561d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+12:14899:x1871640273217664:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 Request processed in 477us (5515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935724.809582:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 159 00000100:00100000:2.0:1784935724.832470:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935724.832503:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273217792 00000100:00100000:2.0:1784935724.832512:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273217792 00000100:00100000:2.0:1784935724.832560:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 160 00000100:00100000:2.0:1784935724.832570:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+12:14899:x1871640273217792:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935724.832695:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+12:14899:x1871640273217792:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 Request processed in 126us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935724.832702:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 160 00000100:00100000:2.0:1784935724.847070:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935724.849245:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273217920 00000100:00100000:3.0:1784935724.849266:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273217920 00000100:00100000:3.0:1784935724.849333:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 161 00000100:00100000:3.0:1784935724.849342:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4546508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+12:14899:x1871640273217920:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784935724.849358:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935724.849375:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d4541529400/0x857e02f4e0b17c30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x992e448fd313ade6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935724.849401:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d4541529400/0x857e02f4e0b17c30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ade6 expref: 13 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935724.849412:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d4541529400/0x857e02f4e0b17c30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ade6 expref: 13 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935724.849422:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529400, rc 0) 00000100:00100000:3.0:1784935724.849596:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4546508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07085f05-e0be-469f-87e0-210ab47bba20+13:14899:x1871640273217920:12345-192.168.203.28@tcp:101:ll_cfg_requeue.0 Request processed in 255us (2534us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935724.849603:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 161 00000100:00100000:1.0:1784935724.860009:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935724.860044:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273218048 00000100:00100000:1.0:1784935724.860053:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273218048 00000100:00100000:1.0:1784935724.860101:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 162 00000100:00100000:1.0:1784935724.860112:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d454650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+13:14899:x1871640273218048:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784935724.860355:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d454650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+13:14899:x1871640273218048:12345-192.168.203.28@tcp:501:ll_cfg_requeue.0 Request processed in 244us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935724.860363:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 162 00000100:00100000:0.0:1784935724.877851:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935724.878610:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273218176 00000100:00100000:2.0:1784935724.878621:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273218176 00000100:00100000:2.0:1784935724.878669:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 163 00000100:00100000:2.0:1784935724.878677:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+13:14899:x1871640273218176:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784935724.878800:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07085f05-e0be-469f-87e0-210ab47bba20+13:14899:x1871640273218176:12345-192.168.203.28@tcp:503:ll_cfg_requeue.0 Request processed in 123us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935724.878807:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 163 00000100:00100000:3.0:1784935724.976974:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784935724.977006:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292169856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784935724.977116:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935724.977174:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292169856 00000100:00100000:3.0:1784935724.977180:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292169856 00000100:00100000:3.0:1784935724.977254:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784935724.977262:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292169856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784935724.977292:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784935724.977337:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292169856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935724.977344:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784935724.977399:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292169856:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784935724.977411:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1784935725.296328:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784935725.362395:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935725.485187:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784935725.485213:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292169984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935725.485292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935725.485344:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292169984 00000100:00100000:3.0:1784935725.485351:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292169984 00000100:00100000:3.0:1784935725.485405:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784935725.485415:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292169984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784935725.485444:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784935725.485483:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292169984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935725.485490:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1784935725.485509:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784935725.485544:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292169984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935725.485740:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784935725.485751:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292170112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784935725.485782:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935725.486022:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292170368:0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486053:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292170624:0@lo:400:kworker.0 00000100:00100000:1.0:1784935725.486054:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935725.486077:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292170880:0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486079:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935725.486097:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292171136:0@lo:400:kworker.0 00000100:00100000:1.0:1784935725.486099:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935725.486113:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292171392:0@lo:400:kworker.0 00000100:00100000:1.0:1784935725.486128:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935725.486144:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935725.486144:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784935725.486150:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292170240:0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486170:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784935725.486176:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292170496:0@lo:400:kworker.0 00000100:00100000:1.0:1784935725.486183:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935725.486194:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935725.486208:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292171008:0@lo:400:kworker.0 00000100:00100000:1.0:1784935725.486208:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292170752:0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486225:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935725.486227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935725.486244:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292170368 00000100:00100000:2.0:1784935725.486249:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292170368 00000100:00100000:1.0:1784935725.486251:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292171264:0@lo:400:kworker.0 00000100:00100000:1.0:1784935725.486272:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935725.486276:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292170624 00000100:00100000:2.0:1784935725.486278:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292170624 00000100:00100000:1.0:1784935725.486291:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292170880 00000100:00100000:2.0:1784935725.486292:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784935725.486294:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292170880 00000100:00100000:2.0:1784935725.486298:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292170368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935725.486311:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292171392 00000100:00100000:1.0:1784935725.486314:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292171392 00000100:00100000:1.0:1784935725.486332:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292171136 00000100:00100000:1.0:1784935725.486335:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292171136 00000100:00100000:2.0:1784935725.486336:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1871640292170368:12345-0@lo:400:kworker.0 Request processed in 38us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935725.486342:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784935725.486346:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292170496 00000100:00100000:1.0:1784935725.486348:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292170496 00000100:00100000:2.0:1784935725.486353:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784935725.486357:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292171008 00000100:00100000:2.0:1784935725.486359:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292170624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935725.486359:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292171008 00000100:00100000:1.0:1784935725.486368:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292171264 00000100:00100000:1.0:1784935725.486371:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292171264 00000100:00100000:1.0:1784935725.486383:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784935725.486387:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292170624:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935725.486388:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292170880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486393:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784935725.486421:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784935725.486428:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292171392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935725.486436:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1871640292170880:12345-0@lo:400:kworker.0 Request processed in 47us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935725.486442:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784935725.486450:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1871640292171392:12345-0@lo:400:kworker.0 Request processed in 24us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935725.486454:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784935725.486456:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784935725.486459:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292171136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486466:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784935725.486477:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292170496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935725.486483:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1871640292171136:12345-0@lo:400:kworker.0 Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935725.486488:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784935725.486499:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784935725.486500:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292170496:12345-0@lo:400:kworker.0 Request processed in 23us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935725.486504:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292171008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486505:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784935725.486514:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784935725.486519:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292171264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935725.486526:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292171008:12345-0@lo:400:kworker.0 Request processed in 22us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935725.486539:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292171264:12345-0@lo:400:kworker.0 Request processed in 20us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935725.486540:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784935725.486544:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784935725.486558:0:17190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292170240 00000100:00100000:2.0:1784935725.486560:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292170752 00000100:00100000:2.0:1784935725.486561:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292170752 00000100:00100000:1.0:1784935725.486561:0:17190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292170240 00000100:00100000:2.0:1784935725.486583:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784935725.486583:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784935725.486588:0:17190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3652:x1871640292170240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486589:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292170752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486616:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292170752:12345-0@lo:400:kworker.0 Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935725.486616:0:17190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3652:x1871640292170240:12345-0@lo:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935725.486622:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784935725.486622:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784935725.486650:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292170240:0@lo:400:kworker.0 00000100:00080000:1.0:1784935725.486651:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784935725.486655:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784935725.486657:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784935725.486661:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292170752:0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486669:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292171264:0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486677:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1871640292170880:0@lo:400:kworker.0 00010000:00080000:2.0:1784935725.486692:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443d37b80 x1871640292171392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935725.486702:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1871640292171392:0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486723:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1871640292170368:0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486756:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292170496:0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486764:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292171008:0@lo:400:kworker.0 00000100:00100000:2.0:1784935725.486771:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292170624:0@lo:400:kworker.0 00010000:00080000:2.0:1784935725.486780:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443cd6d80 x1871640292171136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784935725.486788:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1871640292171136:0@lo:400:kworker.0 00000100:00100000:3.0:1784935725.487187:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292170112 00000100:00100000:3.0:1784935725.487193:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292170112 00000100:00100000:3.0:1784935725.487242:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784935725.487248:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292170112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784935725.487263:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784935725.487304:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871640292170112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935725.487311:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1784935725.488439:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784935725.488495:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1871640292170112:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1784935726.383182:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784935726.751601:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935726.751893:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273218304 00000100:00100000:2.0:1784935726.751902:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273218304 00000100:00100000:2.0:1784935726.752029:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:2.0:1784935726.752041:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+6:15567:x1871640273218304:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784935726.752061:0:18430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935726.752080:0:18430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17c37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313aded expref: -99 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752310:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752325:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752338:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752352:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752373:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752380:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752513:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300400/0x857e02f4e0b17c4c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752521:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300400/0x857e02f4e0b17c4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752527:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300400/0x857e02f4e0b17c4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935726.752554:0:18430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784935726.752557:0:18430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935726.752708:0:18430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300400/0x857e02f4e0b17c4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752718:0:18430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752725:0:18430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752730:0:18430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752736:0:18430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935726.752740:0:18430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752754:0:18430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752766:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4442a6bb00) 00010000:00010000:2.0:1784935726.752769:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935726.752773:0:18430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752778:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752792:0:18430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752797:0:18430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752802:0:18430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752807:0:18430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935726.752810:0:18430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752816:0:18430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752824:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d4572a2a200) 00010000:00010000:2.0:1784935726.752826:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935726.752829:0:18430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752844:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752876:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17c37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aded expref: 8 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752907:0:18430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300400/0x857e02f4e0b17c4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313aded expref: 7 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.752915:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d4572a2aa00) 00010000:00010000:2.0:1784935726.752917:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784935726.752919:0:18430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300400, rc 0) 00000100:00080000:1.0:1784935726.753338:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935726.753379:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+7:15567:x1871640273218304:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 1340us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935726.753387:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 23 00000100:00100000:2.0:1784935726.766649:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935726.766820:0:17208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273218432 00000100:00100000:0.0:1784935726.766831:0:17208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273218432 00000100:00100000:0.0:1784935726.766890:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 5 00000100:00100000:0.0:1784935726.766900:0:17208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5d45adfc-e178-41b7-9e70-f7155e381607+7:15567:x1871640273218432:12345-192.168.203.28@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1784935726.767023:0:17208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5d45adfc-e178-41b7-9e70-f7155e381607+7:15567:x1871640273218432:12345-192.168.203.28@tcp:900:lhsmtool_posix.0 Request processed in 123us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935726.767031:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 5 00000100:00100000:0.0:1784935726.777344:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935726.777431:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273218688 00000100:00100000:2.0:1784935726.777441:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273218688 00000100:00100000:2.0:1784935726.777514:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:2.0:1784935726.777524:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+7:15567:x1871640273218688:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784935726.777544:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935726.777565:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17c53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313adf4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.777658:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c5a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.777692:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.777705:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.777721:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c61 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.777728:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.777736:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.777853:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b17c68 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.777861:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b17c68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.777869:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b17c68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935726.777878:0:17197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1784935726.778307:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778316:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c5a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778323:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778337:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935726.778341:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778349:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c5a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778362:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d4572a2aa00) 00010000:00010000:2.0:1784935726.778365:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935726.778370:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778376:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17c5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778390:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778396:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c61 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778402:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778407:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935726.778410:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778416:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c61 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778434:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d4572a2a200) 00010000:00010000:2.0:1784935726.778437:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935726.778439:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c61 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.778445:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301e00/0x857e02f4e0b17c61 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.782472:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17c53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313adf4 expref: 10 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.782505:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300e00/0x857e02f4e0b17c68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313adf4 expref: 9 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.782515:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4572a2a100) 00010000:00010000:2.0:1784935726.782518:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935726.782521:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300e00, rc 0) 00000100:00100000:2.0:1784935726.782602:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+9:15567:x1871640273218688:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 5079us (5267us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784935726.782612:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:1.0:1784935726.796534:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935726.796796:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273218816 00000100:00100000:3.0:1784935726.796805:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273218816 00000100:00100000:3.0:1784935726.796873:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:3.0:1784935726.796883:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+9:15567:x1871640273218816:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784935726.797558:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+9:15567:x1871640273218816:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 Request processed in 674us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935726.797566:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:1.0:1784935726.815217:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935726.815317:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273218944 00000100:00100000:2.0:1784935726.815328:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273218944 00000100:00100000:2.0:1784935726.815406:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 26 00000100:00100000:2.0:1784935726.815418:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+5:15567:x1871640273218944:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1784935726.815585:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1784935726.822764:0:17199:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7300us 00000100:00100000:1.0:1784935726.843784:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935726.843960:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273219072 00000100:00100000:0.0:1784935726.843969:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273219072 00000100:00100000:0.0:1784935726.844037:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 27 00000100:00100000:0.0:1784935726.844047:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+9:15573:x1871640273219072:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935726.844064:0:18430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935726.844086:0:18430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17c76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313adfb expref: -99 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844184:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021c00/0x857e02f4e0b17c7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844199:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021c00/0x857e02f4e0b17c7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844211:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021c00/0x857e02f4e0b17c7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844225:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844231:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844237:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844276:0:18430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021c00/0x857e02f4e0b17c7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844283:0:18430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021c00/0x857e02f4e0b17c7d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844290:0:18430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021c00/0x857e02f4e0b17c7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844296:0:18430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4554021c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935726.844299:0:18430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021c00/0x857e02f4e0b17c7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844316:0:18430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021c00/0x857e02f4e0b17c7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844328:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4442a6bb00) 00010000:00010000:0.0:1784935726.844330:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935726.844335:0:18430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021c00/0x857e02f4e0b17c7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844341:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021c00/0x857e02f4e0b17c7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844355:0:18430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844361:0:18430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844366:0:18430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844371:0:18430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935726.844374:0:18430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844380:0:18430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844387:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d45705a8a00) 00010000:00010000:0.0:1784935726.844390:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935726.844393:0:18430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844408:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844440:0:18430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17c76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313adfb expref: 10 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844450:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4442a6bb00) 00010000:00010000:0.0:1784935726.844452:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935726.844455:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4554021200/0x857e02f4e0b17c76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313adfb expref: 10 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.844464:0:18430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4554021200, rc 0) 00000100:00100000:0.0:1784935726.844521:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+9:15573:x1871640273219072:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 475us (747us total) trans 0 rc 301/301 00000100:00100000:0.0:1784935726.844528:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 27 00000100:00100000:1.0:1784935726.865443:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935726.867665:0:17206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273219200 00000100:00100000:2.0:1784935726.867684:0:17206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273219200 00000100:00100000:2.0:1784935726.867749:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 0 00000100:00100000:2.0:1784935726.867761:0:17206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5d45adfc-e178-41b7-9e70-f7155e381607+9:15573:x1871640273219200:12345-192.168.203.28@tcp:700:lfs.0 00000100:00100000:2.0:1784935726.867853:0:17206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5d45adfc-e178-41b7-9e70-f7155e381607+9:15573:x1871640273219200:12345-192.168.203.28@tcp:700:lfs.0 Request processed in 94us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935726.867863:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 0 00000100:00100000:3.0:1784935726.868756:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+5:15567:x1871640273218944:12345-192.168.203.28@tcp:59:lhsmtool_posix.0 Request processed in 53336us (53544us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935726.868766:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 26 00000100:00100000:1.0:1784935726.872510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935726.872905:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273219456 00000100:00100000:3.0:1784935726.872916:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273219456 00000100:00100000:0.0:1784935726.873005:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 28 00000100:00100000:0.0:1784935726.873020:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+9:15573:x1871640273219456:12345-192.168.203.28@tcp:36:lfs.0 00010000:00010000:0.0:1784935726.873075:0:18430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935726.873099:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b17ba4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ad68 expref: 9 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.873119:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4442a6bb00) 00010000:00010000:0.0:1784935726.873125:0:18430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784935726.873193:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.873209:0:18430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313add8 expref: 5 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.873233:0:18430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.873266:0:18430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313add8 expref: 5 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.873279:0:18430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313add8 expref: 5 pid: 17199 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935726.873294:0:18430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18430:1871640292171520:192.168.203.28@tcp:104: 00000100:00100000:0.0:1784935726.873369:0:18430:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45741bd240 going to sleep for 11 seconds 00000100:00100000:2.0:1784935726.877522:0:18430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18430:1871640292171520:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935726.877551:0:18430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935726.878775:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935726.878997:0:17184:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273219584 00000100:00100000:2.0:1784935726.879005:0:17184:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273219584 00010000:00010000:2.0:1784935726.880186:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313add8 expref: 6 pid: 17199 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935726.880232:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 15 00000100:00100000:2.0:1784935726.880244:0:17184:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:721bb6e9-58e8-4959-869d-7891367d4bab+6:2392:x1871640273219584:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935726.880259:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935726.880267:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313add8 expref: 6 pid: 17199 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.880280:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313add8 expref: 6 pid: 17199 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.880302:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17be3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313add8 expref: 6 pid: 17199 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.880337:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4442a6bb00) 00010000:00010000:2.0:1784935726.880342:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.880351:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.880364:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.880400:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935726.880462:0:17184:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:721bb6e9-58e8-4959-869d-7891367d4bab+5:2392:x1871640273219584:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 221us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935726.880470:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 15 00010000:00010000:0.0:1784935726.880612:0:18430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.880619:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.880642:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.880649:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.880656:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784935726.880982:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784935726.882897:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.882923:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.883140:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784935726.883177:0:18430:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c426a0b9 reply state 00000000ff62b017 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.883188:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.883196:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:0.0:1784935726.883198:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784935726.883201:0:18430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784935726.883207:0:18430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784935726.883214:0:18430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.883220:0:18430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.883226:0:18430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.883232:0:18430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030200 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935726.883235:0:18430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.883243:0:18430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.883263:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4442a6bb00) 00010000:00010000:0.0:1784935726.883265:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935726.883269:0:18430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.883275:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17c8b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784935726.883293:0:18430:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c426a0b9 reply state 00000000ff62b017 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.883301:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.883307:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d45705a8a00) 00010000:00010000:0.0:1784935726.883309:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784935726.883311:0:18430:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784935726.883406:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+10:15573:x1871640273219456:12345-192.168.203.28@tcp:36:lfs.0 Request processed in 10386us (10901us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1784935726.883416:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 28 00000100:00100000:0.0:1784935726.930332:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935726.930433:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273219712 00000100:00100000:1.0:1784935726.930443:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273219712 00000100:00100000:1.0:1784935726.930512:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 29 00000100:00100000:1.0:1784935726.930521:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+10:15581:x1871640273219712:12345-192.168.203.28@tcp:101:lctl.0 00010000:00010000:1.0:1784935726.930544:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935726.930579:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17ca0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae02 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.930651:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b17ca7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.930663:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b17ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.930675:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b17ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935726.930714:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784935726.930717:0:17198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784935726.930747:0:17198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b17ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.930769:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17ca0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae02 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.930787:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9e00/0x857e02f4e0b17ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae02 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.930795:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4543da8000) 00010000:00010000:1.0:1784935726.930797:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784935726.930801:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9e00, rc 0) 00000100:00100000:1.0:1784935726.931288:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+11:15581:x1871640273219712:12345-192.168.203.28@tcp:101:lctl.0 Request processed in 765us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935726.931295:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 29 00000040:00080000:2.0:1784935726.957873:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784935726.960288:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935726.960506:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273219840 00000100:00100000:0.0:1784935726.960516:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273219840 00000100:00100000:0.0:1784935726.960583:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 30 00000100:00100000:0.0:1784935726.960594:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:721bb6e9-58e8-4959-869d-7891367d4bab+5:15582:x1871640273219840:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935726.960616:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935726.960635:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17cae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae09 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.960714:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031400/0x857e02f4e0b17cb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.960728:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031400/0x857e02f4e0b17cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.960740:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031400/0x857e02f4e0b17cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935726.960780:0:17197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784935726.960784:0:17197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935726.960802:0:17197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031400/0x857e02f4e0b17cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.960824:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17cae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae09 expref: 7 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.960843:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031400/0x857e02f4e0b17cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae09 expref: 6 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.960851:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4543da8000) 00010000:00010000:0.0:1784935726.960853:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784935726.960857:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540031400, rc 0) 00000100:00100000:0.0:1784935726.962134:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:721bb6e9-58e8-4959-869d-7891367d4bab+6:15582:x1871640273219840:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 1532us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935726.962145:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 30 00000100:00100000:0.0:1784935726.964342:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935726.964919:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273219968 00000100:00100000:3.0:1784935726.964948:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273219968 00000100:00100000:3.0:1784935726.965002:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 31 00000100:00100000:3.0:1784935726.965011:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:721bb6e9-58e8-4959-869d-7891367d4bab+6:15582:x1871640273219968:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935726.965031:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935726.965052:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17cbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae10 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.965113:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17cc3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.965709:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.965722:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.965738:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17cca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.965744:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.965764:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.966787:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528800/0x857e02f4e0b17cd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.966803:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528800/0x857e02f4e0b17cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.966824:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528800/0x857e02f4e0b17cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935726.966869:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784935726.966874:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935726.966897:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528800/0x857e02f4e0b17cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.966910:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.966917:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17cc3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.966923:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.966944:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935726.966948:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.966955:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17cc3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.966976:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4543da8000) 00010000:00010000:3.0:1784935726.966979:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935726.966983:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17cc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.966989:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17cc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.967002:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.967009:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17cca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.967015:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17cca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.967020:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935726.967023:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17cca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.967029:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17cca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.967036:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d45705a8a00) 00010000:00010000:3.0:1784935726.967038:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935726.967041:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17cca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.967046:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17cca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.967089:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17cbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae10 expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.967103:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528800/0x857e02f4e0b17cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae10 expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.967110:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:3.0:1784935726.967112:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784935726.967124:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541528800, rc 0) 00000100:00100000:3.0:1784935726.968094:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:721bb6e9-58e8-4959-869d-7891367d4bab+7:15582:x1871640273219968:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 3076us (3751us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935726.968106:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 31 00000100:00100000:1.0:1784935726.970543:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935726.970671:0:17208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273220096 00000100:00100000:0.0:1784935726.970690:0:17208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273220096 00000100:00100000:0.0:1784935726.970790:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 6 00000100:00100000:0.0:1784935726.970799:0:17208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:721bb6e9-58e8-4959-869d-7891367d4bab+5:15582:x1871640273220096:12345-192.168.203.28@tcp:900:lfs.0 00000100:00100000:0.0:1784935726.970882:0:17208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:721bb6e9-58e8-4959-869d-7891367d4bab+5:15582:x1871640273220096:12345-192.168.203.28@tcp:900:lfs.0 Request processed in 83us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935726.970890:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 6 00000100:00080000:1.0:1784935726.970960:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784935726.973607:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935726.973810:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273220352 00000100:00100000:2.0:1784935726.973818:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273220352 00000100:00100000:2.0:1784935726.973877:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 32 00000100:00100000:2.0:1784935726.973888:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:721bb6e9-58e8-4959-869d-7891367d4bab+7:15582:x1871640273220352:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935726.973908:0:18430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935726.973993:0:18430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17cd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae17 expref: -99 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935726.974094:0:18430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784935726.974207:0:18430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17cd8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae17 expref: 9 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.974240:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4543da8000) 00010000:00010000:2.0:1784935726.974243:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784935726.974249:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17cd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae17 expref: 9 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935726.974271:0:18430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300000, rc 0) 00000100:00100000:2.0:1784935726.974331:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:721bb6e9-58e8-4959-869d-7891367d4bab+8:15582:x1871640273220352:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 444us (728us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1784935726.974338:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 32 00000100:00100000:3.0:1784935726.976142:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935726.977224:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273220608 00000100:00100000:1.0:1784935726.977235:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273220608 00000100:00100000:1.0:1784935726.977296:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 33 00000100:00100000:1.0:1784935726.977305:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:721bb6e9-58e8-4959-869d-7891367d4bab+8:15582:x1871640273220608:12345-192.168.203.28@tcp:36:lfs.0 00010000:00010000:1.0:1784935726.977356:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935726.977381:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528800/0x857e02f4e0b17cd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae10 expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.977399:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:1.0:1784935726.977403:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784935726.977424:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.977437:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.977447:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784935726.977629:0:17198:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1aa5470 reply state 000000006eba4956 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.977642:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.977648:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:1.0:1784935726.977651:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1784935726.977666:0:17198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784935726.977674:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784935726.977752:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:721bb6e9-58e8-4959-869d-7891367d4bab+9:15582:x1871640273220608:12345-192.168.203.28@tcp:36:lfs.0 Request processed in 447us (1617us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1784935726.977760:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 33 00000100:00100000:1.0:1784935726.980512:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935726.980592:0:17200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273220864 00000100:00100000:0.0:1784935726.980600:0:17200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273220864 00000100:00100000:0.0:1784935726.980667:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 2 00000100:00100000:0.0:1784935726.980676:0:17200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:721bb6e9-58e8-4959-869d-7891367d4bab+9:15582:x1871640273220864:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:0.0:1784935726.980877:0:17200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:721bb6e9-58e8-4959-869d-7891367d4bab+10:15582:x1871640273220864:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 201us (374us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1784935726.980886:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 2 00000100:00100000:2.0:1784935726.983665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935726.983834:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273221120 00000100:00100000:0.0:1784935726.983843:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273221120 00000100:00100000:0.0:1784935726.984143:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 34 00000100:00100000:0.0:1784935726.984164:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:721bb6e9-58e8-4959-869d-7891367d4bab+10:15582:x1871640273221120:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935726.984188:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935726.984208:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17ced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae1e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.984279:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b17cf4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.984292:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b17cf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.984303:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b17cf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.984325:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17cfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.984332:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17cfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935726.984338:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17cfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935726.984426:0:17197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784935726.985413:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b17cf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985423:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b17cf4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985428:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b17cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985431:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935726.985435:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b17cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985440:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b17cf4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985450:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4543da8000) 00010000:00010000:1.0:1784935726.985452:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935726.985455:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b17cf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985459:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030400/0x857e02f4e0b17cf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985468:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17cfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985483:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17cfb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985489:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17cfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985494:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935726.985497:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17cfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985505:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17cfb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985512:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d45705a8a00) 00010000:00010000:1.0:1784935726.985515:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784935726.985517:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17cfb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985522:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17cfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985576:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17ced lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae1e expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985585:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4543da8000) 00010000:00010000:1.0:1784935726.985587:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784935726.985590:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17ced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae1e expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935726.985609:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540031000, rc 0) 00000100:00100000:1.0:1784935726.985682:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:721bb6e9-58e8-4959-869d-7891367d4bab+11:15582:x1871640273221120:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 1520us (2024us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1784935726.985694:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 34 00000100:00100000:1.0:1784935726.988221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935726.988480:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273221248 00000100:00100000:3.0:1784935726.988489:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273221248 00000100:00100000:3.0:1784935726.988544:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 35 00000100:00100000:3.0:1784935726.988554:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:721bb6e9-58e8-4959-869d-7891367d4bab+11:15582:x1871640273221248:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:3.0:1784935726.988577:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935726.988596:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d09 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae25 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.988685:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.988699:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.988727:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935726.988754:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784935726.988758:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784935726.988776:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.988801:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d09 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae25 expref: 13 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.988818:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae25 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935726.988827:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:3.0:1784935726.988830:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784935726.988833:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529e00, rc 0) 00000100:00100000:3.0:1784935726.988895:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:721bb6e9-58e8-4959-869d-7891367d4bab+12:15582:x1871640273221248:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 343us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935726.988903:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 35 00000100:00100000:0.0:1784935726.992084:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935726.992209:0:17201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273221376 00000100:00100000:3.0:1784935726.992217:0:17201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273221376 00000100:00100000:3.0:1784935726.992261:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 3 00000100:00100000:3.0:1784935726.992271:0:17201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:721bb6e9-58e8-4959-869d-7891367d4bab+12:15582:x1871640273221376:12345-192.168.203.28@tcp:37:lfs.0 00000100:00100000:3.0:1784935726.996214:0:17201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:721bb6e9-58e8-4959-869d-7891367d4bab+12:15582:x1871640273221376:12345-192.168.203.28@tcp:37:lfs.0 Request processed in 3936us (4131us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935726.996487:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 3 00000100:00100000:1.0:1784935726.999678:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935727.000015:0:17200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273221632 00000100:00100000:0.0:1784935727.000024:0:17200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273221632 00000100:00100000:0.0:1784935727.000132:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 4 00000100:00100000:0.0:1784935727.000143:0:17200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443663050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:721bb6e9-58e8-4959-869d-7891367d4bab+12:15582:x1871640273221632:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:0.0:1784935727.000355:0:17200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443663050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:721bb6e9-58e8-4959-869d-7891367d4bab+13:15582:x1871640273221632:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 214us (685us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1784935727.000363:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 4 00000100:00100000:1.0:1784935727.042195:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935727.042340:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273221760 00000100:00100000:2.0:1784935727.042349:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273221760 00000100:00100000:2.0:1784935727.042418:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 36 00000100:00100000:2.0:1784935727.042428:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+11:15588:x1871640273221760:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:2.0:1784935727.042451:0:18430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935727.042481:0:18430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301200/0x857e02f4e0b17d17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae2c expref: -99 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.042541:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.042555:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.042566:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.042595:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.042602:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.042609:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.042687:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b17d2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.042696:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b17d2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.042703:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b17d2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935727.042734:0:18430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784935727.042738:0:18430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935727.042785:0:18430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b17d2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.042798:0:18430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043272:0:18430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043279:0:18430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043294:0:18430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935727.043299:0:18430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043306:0:18430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043318:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4543da8000) 00010000:00010000:2.0:1784935727.043321:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935727.043326:0:18430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043332:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043348:0:18430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043354:0:18430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043408:0:18430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043413:0:18430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935727.043416:0:18430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043423:0:18430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043441:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d45705a8a00) 00010000:00010000:2.0:1784935727.043443:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935727.043446:0:18430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043451:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043540:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301200/0x857e02f4e0b17d17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae2c expref: 13 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043555:0:18430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301600/0x857e02f4e0b17d2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae2c expref: 12 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.043563:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:2.0:1784935727.043566:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784935727.043568:0:18430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d301600, rc 0) 00000100:00100000:2.0:1784935727.043675:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+12:15588:x1871640273221760:12345-192.168.203.28@tcp:101:bash.0 Request processed in 1247us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935727.043682:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 36 00000100:00100000:2.0:1784935727.050321:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935727.050463:0:17209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273221888 00000100:00100000:0.0:1784935727.050471:0:17209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273221888 00000100:00100000:0.0:1784935727.050555:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:0.0:1784935727.050565:0:17209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5d45adfc-e178-41b7-9e70-f7155e381607+5:15588:x1871640273221888:12345-192.168.203.28@tcp:900:bash.0 00000100:00100000:0.0:1784935727.050649:0:17209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5d45adfc-e178-41b7-9e70-f7155e381607+5:15588:x1871640273221888:12345-192.168.203.28@tcp:900:bash.0 Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935727.050656:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:1.0:1784935727.052777:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935727.052850:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273222144 00000100:00100000:3.0:1784935727.052868:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273222144 00000100:00100000:3.0:1784935727.052920:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 37 00000100:00100000:3.0:1784935727.052964:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+12:15588:x1871640273222144:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:3.0:1784935727.052984:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935727.053004:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d33 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae33 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.053091:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.053105:0:17198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae25 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.053114:0:17198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.053265:0:17198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae25 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.053281:0:17198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae25 expref: 12 pid: 17199 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935727.053297:0:17198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17198:1871640292171648:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935727.053379:0:17198:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d455e1fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1784935727.057379:0:17198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17198:1871640292171648:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935727.057410:0:17198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935727.057806:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935727.057961:0:17185:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273222272 00000100:00100000:2.0:1784935727.057968:0:17185:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273222272 00010000:00010000:2.0:1784935727.058010:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae25 expref: 13 pid: 17199 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935727.058097:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 16 00000100:00100000:2.0:1784935727.058107:0:17185:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:721bb6e9-58e8-4959-869d-7891367d4bab+13:2392:x1871640273222272:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935727.058132:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935727.058140:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae25 expref: 13 pid: 17199 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.058162:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae25 expref: 13 pid: 17199 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.058183:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529e00/0x857e02f4e0b17d10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae25 expref: 13 pid: 17199 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.058201:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:2.0:1784935727.058205:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.058215:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.058222:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.058247:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935727.058304:0:17185:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:721bb6e9-58e8-4959-869d-7891367d4bab+12:2392:x1871640273222272:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 198us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935727.058312:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 16 00010000:00010000:3.0:1784935727.058407:0:17198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.058415:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.058438:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.058449:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.058457:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.058901:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17d48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.058911:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17d48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.058919:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17d48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784935727.058959:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784935727.058985:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.058993:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.059000:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.059013:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935727.059018:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.059026:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.059036:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:3.0:1784935727.059039:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784935727.059043:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.059049:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17d3a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784935727.059060:0:17198:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a05812da reply state 00000000b26331bc transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.059070:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.059076:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d45512ed700) 00010000:00010000:3.0:1784935727.059078:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784935727.059081:0:17198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784935727.059113:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d33 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae33 expref: 15 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.059128:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17d48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae33 expref: 14 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.059155:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:3.0:1784935727.059158:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1784935727.059161:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529000, rc 0) 00000100:00100000:3.0:1784935727.059197:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+15:15588:x1871640273222144:12345-192.168.203.28@tcp:101:bash.0 Request processed in 6269us (6426us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1784935727.059204:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 37 00000100:00100000:1.0:1784935727.076700:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935727.076905:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273222400 00000100:00100000:2.0:1784935727.076916:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273222400 00000100:00100000:2.0:1784935727.077200:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 38 00000100:00100000:2.0:1784935727.077212:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+15:15588:x1871640273222400:12345-192.168.203.28@tcp:101:bash.0 00010000:00010000:2.0:1784935727.077256:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935727.077276:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d56 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae3a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.077343:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.077358:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.077369:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935727.077421:0:17197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784935727.077426:0:17197:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935727.077444:0:17197:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.077454:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.077477:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d56 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae3a expref: 17 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.077498:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae3a expref: 16 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.077507:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:2.0:1784935727.077510:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935727.077513:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300600, rc 0) 00000100:00100000:2.0:1784935727.077582:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+16:15588:x1871640273222400:12345-192.168.203.28@tcp:101:bash.0 Request processed in 373us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935727.077597:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 38 00000100:00100000:1.0:1784935727.082679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935727.082771:0:17201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273222656 00000100:00100000:2.0:1784935727.082780:0:17201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273222656 00000100:00100000:2.0:1784935727.082924:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 5 00000100:00100000:2.0:1784935727.082963:0:17201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d45adfc-e178-41b7-9e70-f7155e381607+16:15588:x1871640273222656:12345-192.168.203.28@tcp:35:bash.0 00000100:00100000:2.0:1784935727.083424:0:17201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d45adfc-e178-41b7-9e70-f7155e381607+17:15588:x1871640273222656:12345-192.168.203.28@tcp:35:bash.0 Request processed in 462us (752us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1784935727.083432:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 5 00000100:00100000:1.0:1784935727.160264:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935727.160320:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273222912 00000100:00100000:2.0:1784935727.160329:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273222912 00000100:00100000:2.0:1784935727.160402:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 39 00000100:00100000:2.0:1784935727.160412:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+17:15598:x1871640273222912:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:2.0:1784935727.160441:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935727.160822:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae41 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935727.161110:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784935727.161240:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d64 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae41 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.161270:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d4543da8000) 00010000:00010000:0.0:1784935727.161273:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784935727.161278:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae41 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.161296:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300c00, rc 0) 00000100:00100000:0.0:1784935727.161421:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+18:15598:x1871640273222912:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 1010us (1167us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1784935727.161429:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 39 00000100:00100000:1.0:1784935727.164358:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935727.164443:0:17200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273223168 00000100:00100000:0.0:1784935727.164463:0:17200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273223168 00000100:00100000:0.0:1784935727.164601:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 6 00000100:00100000:0.0:1784935727.164612:0:17200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45adfc-e178-41b7-9e70-f7155e381607+18:15598:x1871640273223168:12345-192.168.203.28@tcp:35:lfs.0 00000100:00100000:0.0:1784935727.165345:0:17200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45adfc-e178-41b7-9e70-f7155e381607+19:15598:x1871640273223168:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 234us (498us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1784935727.165354:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 6 00000100:00100000:1.0:1784935727.188988:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935727.190500:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273223424 00000100:00100000:0.0:1784935727.190516:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273223424 00000100:00100000:0.0:1784935727.190652:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 40 00000100:00100000:0.0:1784935727.190663:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+19:15601:x1871640273223424:12345-192.168.203.28@tcp:101:lfs.0 00010000:00010000:0.0:1784935727.190688:0:18430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935727.190709:0:18430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17d72 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae48 expref: -99 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.190819:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17d79 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.190844:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17d79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.190855:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17d79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935727.190866:0:18430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784935727.191171:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17d72 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae48 expref: 22 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.191191:0:18430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17d79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae48 expref: 21 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.191200:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:0.0:1784935727.191203:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935727.191206:0:18430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540030c00, rc 0) 00000100:00100000:0.0:1784935727.191283:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+21:15601:x1871640273223424:12345-192.168.203.28@tcp:101:lfs.0 Request processed in 623us (2305us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1784935727.191290:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 40 00000100:00100000:1.0:1784935727.195492:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935727.195571:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273223552 00000100:00100000:3.0:1784935727.195583:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273223552 00000100:00100000:3.0:1784935727.195654:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 41 00000100:00100000:3.0:1784935727.195665:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+21:15601:x1871640273223552:12345-192.168.203.28@tcp:54:lfs.0 00010000:00010000:3.0:1784935727.195737:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.195754:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.195765:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.195799:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.195810:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d87 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.195817:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.195823:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:3.0:1784935727.195839:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.195847:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d87 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.195863:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:3.0:1784935727.195866:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784935727.195870:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d87 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.195877:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17d87 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935727.195967:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+21:15601:x1871640273223552:12345-192.168.203.28@tcp:54:lfs.0 Request processed in 304us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935727.195975:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 41 00000100:00100000:1.0:1784935727.198536:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935727.198584:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935727.198631:0:17184:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273223680 00000100:00100000:2.0:1784935727.198640:0:17184:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273223680 00000100:00100000:0.0:1784935727.198739:0:17201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273223936 00000100:00100000:0.0:1784935727.198743:0:17201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273223936 00000100:00100000:2.0:1784935727.198748:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 0 00000100:00100000:2.0:1784935727.198758:0:17184:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d45adfc-e178-41b7-9e70-f7155e381607+22:2394:x1871640273223680:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935727.198773:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784935727.198780:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:0.0:1784935727.198786:0:17201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d45adfc-e178-41b7-9e70-f7155e381607+22:15601:x1871640273223936:12345-192.168.203.28@tcp:35:lfs.0 00010000:00010000:2.0:1784935727.198797:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17d79 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae48 expref: 22 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.198833:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:2.0:1784935727.198837:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935727.198885:0:17184:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d45adfc-e178-41b7-9e70-f7155e381607+21:2394:x1871640273223680:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 128us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935727.198893:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 0 00000100:00100000:0.0:1784935727.199237:0:17201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d45adfc-e178-41b7-9e70-f7155e381607+21:15601:x1871640273223936:12345-192.168.203.28@tcp:35:lfs.0 Request processed in 450us (651us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1784935727.199244:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 7 00000100:00100000:1.0:1784935727.274068:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935727.274307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935727.274342:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935727.274377:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935727.274403:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935727.274430:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273224320 00000100:00100000:1.0:1784935727.274439:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273224320 00000100:00100000:1.0:1784935727.274501:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273224576 00000100:00100000:1.0:1784935727.274505:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273224576 00000100:00100000:3.0:1784935727.274528:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273224192 00000100:00100000:3.0:1784935727.274532:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273224192 00000100:00100000:1.0:1784935727.274533:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273224448 00000100:00100000:1.0:1784935727.274535:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273224448 00000100:00100000:1.0:1784935727.274550:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:1.0:1784935727.274605:0:18703:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d45adfc-e178-41b7-9e70-f7155e381607+5:2394:x1871640273224320:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:1.0:1784935727.274681:0:18703:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d45adfc-e178-41b7-9e70-f7155e381607+5:2394:x1871640273224320:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 123us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935727.274913:0:17191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273224064 00000100:00100000:2.0:1784935727.274917:0:17191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273224064 00000100:00100000:2.0:1784935727.274976:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 165 00000100:00100000:2.0:1784935727.274983:0:17191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+13:2394:x1871640273224064:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:2.0:1784935727.275013:0:17191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07085f05-e0be-469f-87e0-210ab47bba20+13:2394:x1871640273224064:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 31us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935727.275020:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 165 00000100:00100000:3.0:1784935727.281352:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:3.0:1784935727.281378:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45449e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:721bb6e9-58e8-4959-869d-7891367d4bab+5:2394:x1871640273224576:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935727.281463:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45449e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:721bb6e9-58e8-4959-869d-7891367d4bab+5:2394:x1871640273224576:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 98us (7119us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935727.281471:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:3.0:1784935727.281500:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 19 00000100:00100000:3.0:1784935727.281508:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:721bb6e9-58e8-4959-869d-7891367d4bab+5:2393:x1871640273224448:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935727.281532:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:721bb6e9-58e8-4959-869d-7891367d4bab+5:2393:x1871640273224448:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 26us (7128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935727.281553:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 19 00000100:00100000:3.0:1784935727.281566:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:3.0:1784935727.281571:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d45adfc-e178-41b7-9e70-f7155e381607+5:2393:x1871640273224192:12345-192.168.203.28@tcp:400:kworker.0 00000100:00100000:3.0:1784935727.281596:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d45adfc-e178-41b7-9e70-f7155e381607+5:2393:x1871640273224192:12345-192.168.203.28@tcp:400:kworker.0 Request processed in 24us (7218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935727.281602:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00080000:3.0:1784935727.282837:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784935727.282846:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784935727.284786:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 17 00000040:00080000:3.0:1784935727.342980:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784935727.405162:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935727.505790:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935727.508553:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273224832 00000100:00100000:2.0:1784935727.508569:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273224832 00000100:00100000:2.0:1784935727.508645:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 42 00000100:00100000:2.0:1784935727.508656:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+21:15632:x1871640273224832:12345-192.168.203.28@tcp:101:cat.0 00010000:00010000:2.0:1784935727.508682:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935727.508705:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d8e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae4f expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.508810:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301200/0x857e02f4e0b17d95 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.508836:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301200/0x857e02f4e0b17d95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.508867:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301200/0x857e02f4e0b17d95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935727.508880:0:17197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784935727.513367:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17d8e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae4f expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.513402:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301200/0x857e02f4e0b17d95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae4f expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.513413:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:2.0:1784935727.513416:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784935727.513420:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d301200, rc 0) 00000100:00100000:2.0:1784935727.513513:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+23:15632:x1871640273224832:12345-192.168.203.28@tcp:101:cat.0 Request processed in 4853us (7727us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1784935727.513522:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 42 00000100:00100000:3.0:1784935727.520392:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935727.520445:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935727.520550:0:17185:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273225216 00000100:00100000:2.0:1784935727.520560:0:17185:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273225216 00000100:00100000:2.0:1784935727.520622:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 1 00000100:00100000:2.0:1784935727.520631:0:17185:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d45adfc-e178-41b7-9e70-f7155e381607+23:2393:x1871640273225216:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935727.520646:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935727.520669:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301200/0x857e02f4e0b17d95 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae4f expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.520689:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:2.0:1784935727.520693:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935727.520758:0:17185:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d45adfc-e178-41b7-9e70-f7155e381607+22:2393:x1871640273225216:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935727.520766:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 1 00000100:00100000:0.0:1784935727.522110:0:17200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273225088 00000100:00100000:0.0:1784935727.522132:0:17200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273225088 00000100:00100000:0.0:1784935727.522196:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 8 00000100:00100000:0.0:1784935727.522205:0:17200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45adfc-e178-41b7-9e70-f7155e381607+22:15632:x1871640273225088:12345-192.168.203.28@tcp:35:cat.0 00000100:00100000:0.0:1784935727.522459:0:17200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45adfc-e178-41b7-9e70-f7155e381607+23:15632:x1871640273225088:12345-192.168.203.28@tcp:35:cat.0 Request processed in 255us (2076us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1784935727.522704:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 8 00000100:00100000:3.0:1784935727.599921:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935727.600238:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273225472 00000100:00100000:1.0:1784935727.600248:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273225472 00000100:00100000:1.0:1784935727.600303:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 43 00000100:00100000:1.0:1784935727.600314:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+23:15638:x1871640273225472:12345-192.168.203.28@tcp:101:dd.0 00010000:00010000:1.0:1784935727.600341:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935727.600364:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17da3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae56 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.600484:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b17daa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.600499:0:17198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17d48 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae33 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.600507:0:17198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae3a expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.600515:0:17198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b17daa lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.600546:0:17198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae3a expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.600571:0:17198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae3a expref: 24 pid: 17197 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935727.600585:0:17198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443591f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17198:1871640292171776:192.168.203.28@tcp:104: 00010000:00010000:1.0:1784935727.600673:0:17198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17d48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae33 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.600682:0:17198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17d48 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae33 expref: 24 pid: 17198 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935727.600690:0:17198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443590380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17198:1871640292171904:192.168.203.28@tcp:104: 00000100:00100000:1.0:1784935727.600712:0:17198:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45430a5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784935727.604806:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935727.604856:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935727.604963:0:17184:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273225600 00000100:00100000:0.0:1784935727.604966:0:17185:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273225728 00000100:00100000:2.0:1784935727.604972:0:17184:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273225600 00000100:00100000:0.0:1784935727.604973:0:17185:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273225728 00010000:00010000:0.0:1784935727.605067:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17d48 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae33 expref: 26 pid: 17198 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935727.605272:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:1.0:1784935727.605283:0:17183:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d45705ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d45adfc-e178-41b7-9e70-f7155e381607+26:2392:x1871640273225728:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935727.605299:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935727.605307:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17d48 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae33 expref: 26 pid: 17198 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.605319:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17d48 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae33 expref: 26 pid: 17198 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.605342:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:1.0:1784935727.605358:0:17183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b17daa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.605366:0:17183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b17daa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.605373:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935727.605431:0:17183:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d45705ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d45adfc-e178-41b7-9e70-f7155e381607+26:2392:x1871640273225728:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 150us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935727.605439:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 17 00000100:00100000:3.0:1784935727.605863:0:17198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443591f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17198:1871640292171776:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935727.605877:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17d48 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae33 expref: 26 pid: 17198 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935727.605893:0:17198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443590380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17198:1871640292171904:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935727.605915:0:17198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b17daa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.609088:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae3a expref: 25 pid: 17197 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935727.609278:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 18 00000100:00100000:2.0:1784935727.609298:0:17184:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d45adfc-e178-41b7-9e70-f7155e381607+25:2392:x1871640273225600:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935727.609314:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935727.609322:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae3a expref: 24 pid: 17197 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.609343:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae3a expref: 24 pid: 17197 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.609371:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17d5d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae3a expref: 24 pid: 17197 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.609392:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:2.0:1784935727.609398:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b17daa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.609411:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b17daa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.609418:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b17daa lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.609476:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784935727.609542:0:17198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b17daa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.609552:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b17daa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935727.609557:0:17184:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d45adfc-e178-41b7-9e70-f7155e381607+23:2392:x1871640273225600:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 267us (4757us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935727.609575:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 18 00000004:00200000:3.0:1784935727.609587:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784935727.609730:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9200/0x857e02f4e0b17da3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae56 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.609742:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8400/0x857e02f4e0b17daa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae56 expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935727.609747:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:3.0:1784935727.609749:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784935727.609751:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b8400, rc 0) 00000100:00100000:3.0:1784935727.609770:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+23:15638:x1871640273225472:12345-192.168.203.28@tcp:101:dd.0 Request processed in 9460us (9861us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1784935727.609775:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 43 00000100:00100000:1.0:1784935727.613428:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935727.613494:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273225856 00000100:00100000:0.0:1784935727.613514:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273225856 00000100:00100000:0.0:1784935727.613582:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 44 00000100:00100000:0.0:1784935727.613592:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+23:15638:x1871640273225856:12345-192.168.203.28@tcp:101:dd.0 00010000:00010000:0.0:1784935727.613615:0:18430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935727.613636:0:18430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17db8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae5d expref: -99 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.613671:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17dbf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.613686:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17dbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.613698:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17dbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.613813:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17db8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae5d expref: 25 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.613850:0:18430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17dbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae5d expref: 24 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.613859:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:0.0:1784935727.613862:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784935727.613866:0:18430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540031c00, rc 0) 00000100:00100000:0.0:1784935727.613967:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+24:15638:x1871640273225856:12345-192.168.203.28@tcp:101:dd.0 Request processed in 367us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935727.613975:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 44 00000100:00100000:3.0:1784935727.617602:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935727.617657:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273226112 00000100:00100000:0.0:1784935727.617667:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273226112 00000100:00100000:0.0:1784935727.617728:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 45 00000100:00100000:0.0:1784935727.617738:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+24:15638:x1871640273226112:12345-192.168.203.28@tcp:36:dd.0 00010000:00010000:0.0:1784935727.618426:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.618443:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.618455:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784935727.618498:0:17199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1784935727.618521:0:17199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7d1089b reply state 00000000319e56c8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.618542:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.618562:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:0.0:1784935727.618565:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784935727.618568:0:17199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784935727.618662:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+27:15638:x1871640273226112:12345-192.168.203.28@tcp:36:dd.0 Request processed in 925us (1068us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1784935727.618670:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 45 00000020:00080000:0.0:1784935727.618675:0:17199:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784935727.621311:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935727.621391:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273226240 00000100:00100000:0.0:1784935727.621401:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273226240 00000100:00100000:2.0:1784935727.621547:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 46 00000100:00100000:2.0:1784935727.621559:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+27:15638:x1871640273226240:12345-192.168.203.28@tcp:101:dd.0 00010000:00010000:2.0:1784935727.621583:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935727.621600:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17dcd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae64 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.621652:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17dcd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae64 expref: 28 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.621666:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17dcd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae64 expref: 28 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.621684:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:2.0:1784935727.621687:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784935727.621690:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300600, rc 0) 00000100:00100000:2.0:1784935727.621747:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+28:15638:x1871640273226240:12345-192.168.203.28@tcp:101:dd.0 Request processed in 192us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935727.621754:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 46 00000100:00100000:1.0:1784935727.635374:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935727.635541:0:17185:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273226496 00000100:00100000:0.0:1784935727.635551:0:17185:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273226496 00000100:00100000:0.0:1784935727.635615:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 2 00000100:00100000:0.0:1784935727.635625:0:17185:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d45adfc-e178-41b7-9e70-f7155e381607+28:15638:x1871640273226496:12345-192.168.203.28@tcp:103:dd.0 00010000:00010000:0.0:1784935727.635641:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935727.635664:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300600/0x857e02f4e0b17dcd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae64 expref: 28 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.635690:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:0.0:1784935727.635695:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935727.635758:0:17185:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d45adfc-e178-41b7-9e70-f7155e381607+27:15638:x1871640273226496:12345-192.168.203.28@tcp:103:dd.0 Request processed in 134us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935727.635765:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 2 00000100:00100000:3.0:1784935727.638603:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935727.638695:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273226624 00000100:00100000:1.0:1784935727.638706:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273226624 00000100:00100000:1.0:1784935727.638762:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 47 00000100:00100000:1.0:1784935727.638772:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+27:15638:x1871640273226624:12345-192.168.203.28@tcp:58:dd.0 00010000:00010000:1.0:1784935727.639029:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.639047:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935727.639059:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784935727.641270:0:17198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784935727.641789:0:17198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1784935727.642031:0:17198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1784935727.642313:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+27:15638:x1871640273226624:12345-192.168.203.28@tcp:58:dd.0 Request processed in 3536us (3714us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935727.642335:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 47 00000100:00100000:3.0:1784935727.645002:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935727.645256:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273226752 00000100:00100000:2.0:1784935727.645265:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273226752 00000100:00100000:2.0:1784935727.645359:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 48 00000100:00100000:2.0:1784935727.645370:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+27:15638:x1871640273226752:12345-192.168.203.28@tcp:101:dd.0 00010000:00010000:2.0:1784935727.645400:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935727.645421:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17ddb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae6b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.645604:0:17197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.645616:0:17197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17ddb lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae6b expref: 28 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.645636:0:17197:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.645650:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17ddb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae6b expref: 28 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.645663:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:2.0:1784935727.645665:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784935727.645668:0:17197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17ddb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae6b expref: 28 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935727.645676:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300c00, rc 0) 00000100:00100000:2.0:1784935727.645772:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+28:15638:x1871640273226752:12345-192.168.203.28@tcp:101:dd.0 Request processed in 403us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935727.645779:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 48 00000040:00080000:2.0:1784935727.981325:0:17233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784935727.981336:0:17233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784935727.981378:0:17233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1784935727.981391:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1784935727.981515:0:17233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d36300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17233:1871640292172032:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784935727.981600:0:17233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457026d240 going to sleep for 11 seconds 00000100:00100000:3.0:1784935727.988166:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935727.988373:0:17233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d36300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17233:1871640292172032:192.168.203.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784935727.990200:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273226880 00000100:00100000:0.0:1784935727.990215:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273226880 00000100:00100000:0.0:1784935727.990329:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 49 00000100:00100000:0.0:1784935727.990341:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+28:15639:x1871640273226880:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784935727.990375:0:17199:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784935727.990575:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+28:15639:x1871640273226880:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 236us (2417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935727.990583:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 49 00000100:00100000:3.0:1784935727.995113:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935727.998540:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273227008 00000100:00100000:0.0:1784935727.998554:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273227008 00000100:00100000:0.0:1784935727.998652:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:0.0:1784935727.998663:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+28:15639:x1871640273227008:12345-192.168.203.28@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784935727.998737:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17de2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.998753:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17de2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.998767:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17de2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.998782:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17de9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.998789:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17de9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.998795:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17de9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.998880:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17df0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.998890:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.998897:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784935727.999583:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784935727.999589:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784935727.999606:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999619:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17de2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999626:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17de2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999632:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17de2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999637:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935727.999640:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17de2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999647:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17de2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999659:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4572a2a100) 00010000:00010000:0.0:1784935727.999662:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935727.999667:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17de2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999673:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030e00/0x857e02f4e0b17de2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999686:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17de9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999703:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17de9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999707:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17de9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999712:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540031000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935727.999715:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17de9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999720:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17de9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999727:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d45705a8b00) 00010000:00010000:0.0:1784935727.999730:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935727.999732:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17de9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999738:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17de9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999753:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999759:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17df0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999765:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17df0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999770:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935727.999778:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17df0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999785:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17df0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999960:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:0.0:1784935727.999964:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935727.999967:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17df0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935727.999973:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17df0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935728.000052:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+28:15639:x1871640273227008:12345-192.168.203.28@tcp:34:lhsmtool_posix.0 Request processed in 1389us (4946us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935728.000060:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 50 00000100:00100000:3.0:1784935728.002079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935728.002877:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273227264 00000100:00100000:1.0:1784935728.002888:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273227264 00000100:00080000:3.0:1784935728.002989:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784935728.003158:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00100000:1.0:1784935728.003172:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+28:15639:x1871640273227264:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935728.003193:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935728.003212:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17df7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae72 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.003315:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17dfe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.003329:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17dfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.003340:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17dfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784935728.003351:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784935728.006080:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17dfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.006098:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17dfe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.007732:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17dfe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.007742:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b9800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935728.007747:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17dfe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.007773:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17dfe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.007789:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:1.0:1784935728.007792:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784935728.007806:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17dfe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.007813:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17dfe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.007878:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17df7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae72 expref: 30 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.007888:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d4572a2a100) 00010000:00010000:1.0:1784935728.007890:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784935728.007894:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17df7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae72 expref: 30 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.007903:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9c00, rc 0) 00000100:00100000:1.0:1784935728.008524:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+29:15639:x1871640273227264:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 5353us (6451us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1784935728.008533:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 51 00000100:00100000:3.0:1784935728.013799:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.017081:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273227392 00000100:00100000:0.0:1784935728.017096:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273227392 00000100:00100000:0.0:1784935728.017417:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 52 00000100:00100000:0.0:1784935728.017439:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d457402f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+29:15639:x1871640273227392:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784935728.017477:0:17199:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784935728.017598:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d457402f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+29:15639:x1871640273227392:12345-192.168.203.28@tcp:53:lhsmtool_posix.0 Request processed in 172us (3807us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935728.017606:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 52 00000100:00100000:3.0:1784935728.021420:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.021487:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273227648 00000100:00100000:0.0:1784935728.021497:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273227648 00000100:00100000:0.0:1784935728.021562:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:0.0:1784935728.021572:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+29:15639:x1871640273227648:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784935728.021606:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784935728.021630:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e0c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae79 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784935728.022037:0:17197:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1784935728.022043:0:17197:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1784935728.022065:0:17197:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1784935728.022218:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17e13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.022232:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17e13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.022243:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17e13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.022296:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e0c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae79 expref: 32 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.022314:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17e13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae79 expref: 31 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.022322:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d45705a8b00) 00010000:00010000:0.0:1784935728.022326:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784935728.022329:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4540031000, rc 0) 00000100:00100000:0.0:1784935728.022386:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+31:15639:x1871640273227648:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 816us (975us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1784935728.022394:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 53 00000100:00100000:3.0:1784935728.029149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935728.029523:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273227904 00000100:00100000:2.0:1784935728.029532:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273227904 00000100:00100000:2.0:1784935728.029593:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 54 00000100:00100000:2.0:1784935728.029605:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+31:15639:x1871640273227904:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784935728.029658:0:18430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935728.029685:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031000/0x857e02f4e0b17e13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae79 expref: 31 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029703:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d45705a8b00) 00010000:00010000:2.0:1784935728.029713:0:18430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935728.029732:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17e21 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029745:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17e21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029755:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17e21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029769:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e28 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x45ae7886 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029775:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x45ae7886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029781:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x45ae7886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029839:0:18430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17e21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029847:0:18430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17e21 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029853:0:18430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17e21 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029858:0:18430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d301400 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935728.029862:0:18430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17e21 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029869:0:18430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17e21 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029877:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:2.0:1784935728.029880:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935728.029884:0:18430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17e21 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029890:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d301400/0x857e02f4e0b17e21 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029900:0:18430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x45ae7886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029906:0:18430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x45ae7886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029911:0:18430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x45ae7886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029922:0:18430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935728.029963:0:18430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x45ae7886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029971:0:18430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e28 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x45ae7886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029979:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x45ae7886 (ffff8d4572a2a200) 00010000:00010000:2.0:1784935728.029982:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935728.029985:0:18430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e28 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x45ae7886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.029991:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e28 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x45ae7886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935728.030131:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+30:15639:x1871640273227904:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 529us (1000us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784935728.030138:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 54 00000100:00100000:3.0:1784935728.035741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935728.036850:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273228032 00000100:00100000:1.0:1784935728.036862:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273228032 00000100:00100000:1.0:1784935728.037081:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 55 00000100:00100000:1.0:1784935728.037094:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+30:15639:x1871640273228032:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784935728.037148:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784935728.037173:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17e2f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae80 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.037208:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17e36 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.037221:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17e36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.037233:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17e36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.037333:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9c00/0x857e02f4e0b17e2f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae80 expref: 32 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.037352:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b9800/0x857e02f4e0b17e36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae80 expref: 31 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.037361:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4543da8900) 00010000:00010000:1.0:1784935728.037364:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784935728.037368:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d1b9800, rc 0) 00000100:00100000:1.0:1784935728.037430:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+31:15639:x1871640273228032:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 340us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935728.043014:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 55 00000100:00100000:3.0:1784935728.044273:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.044642:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273228288 00000100:00100000:0.0:1784935728.044661:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273228288 00000100:00100000:0.0:1784935728.044718:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 56 00000100:00100000:0.0:1784935728.044729:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+31:15639:x1871640273228288:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784935728.044816:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.044835:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.044846:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784935728.045339:0:17199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1784935728.045352:0:17199:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 547295423555ns, next at 548295420434ns, rc = 0 00000004:00010000:3.0:1784935728.045403:0:17199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002dc7890c reply state 00000000c854e606 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.045417:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.045425:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4543da8900) 00010000:00010000:3.0:1784935728.045428:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784935728.045431:0:17199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784935728.045536:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+33:15639:x1871640273228288:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 807us (1405us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1784935728.045544:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 56 00000100:00100000:2.0:1784935728.046414:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784935728.046433:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292172160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784935728.046487:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935728.046531:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292172160 00000100:00100000:2.0:1784935728.046539:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292172160 00000100:00100000:2.0:1784935728.046599:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784935728.046608:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292172160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784935728.046634:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1784935728.046663:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784935728.046675:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1871640292172160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935728.046697:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784935728.046763:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1871640292172160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784935728.048895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935728.048995:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273228416 00000100:00100000:3.0:1784935728.049005:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273228416 00000100:00100000:3.0:1784935728.049062:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 57 00000100:00100000:3.0:1784935728.049073:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+33:15639:x1871640273228416:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784935728.049095:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935728.049124:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17e44 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae87 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.049186:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17e44 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae87 expref: 34 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.049201:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17e44 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae87 expref: 34 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.049220:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4543da8900) 00010000:00010000:3.0:1784935728.049235:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784935728.049239:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541529000, rc 0) 00000100:00100000:3.0:1784935728.049302:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+34:15639:x1871640273228416:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 232us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935728.049308:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 57 00000100:00100000:0.0:1784935728.051637:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935728.051973:0:19236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273228544 00000100:00100000:3.0:1784935728.051983:0:19236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273228544 00000100:00100000:3.0:1784935728.052027:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:3.0:1784935728.052036:0:19236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d45adfc-e178-41b7-9e70-f7155e381607+5:2391:x1871640273228544:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1784935728.052599:0:19236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d45adfc-e178-41b7-9e70-f7155e381607+6:2391:x1871640273228544:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 Request processed in 563us (970us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1784935728.052608:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 24 00000100:00100000:2.0:1784935728.055723:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.055917:0:17201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273228800 00000100:00100000:0.0:1784935728.056011:0:17201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273228800 00000100:00100000:1.0:1784935728.056383:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 9 00000100:00100000:1.0:1784935728.056395:0:17201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d45adfc-e178-41b7-9e70-f7155e381607+34:15639:x1871640273228800:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784935728.056609:0:17201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d45adfc-e178-41b7-9e70-f7155e381607+35:15639:x1871640273228800:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 216us (895us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1784935728.056629:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 9 00000100:00100000:2.0:1784935728.058710:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.058822:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273229056 00000100:00100000:0.0:1784935728.058833:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273229056 00000100:00100000:0.0:1784935728.058888:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 58 00000100:00100000:0.0:1784935728.058897:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+35:15639:x1871640273229056:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784935728.059021:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+35:15639:x1871640273229056:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 125us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935728.059028:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 58 00000100:00100000:3.0:1784935728.062042:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935728.062373:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273229184 00000100:00100000:2.0:1784935728.062382:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273229184 00000100:00100000:2.0:1784935728.062438:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 59 00000100:00100000:2.0:1784935728.062448:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+35:15639:x1871640273229184:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784935728.062469:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935728.062488:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b17e4b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae8e expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.062587:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b17e52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.062600:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b17e52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.062611:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b17e52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784935728.062695:0:17198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784935728.062730:0:17198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b17e52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.062781:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300800/0x857e02f4e0b17e4b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae8e expref: 37 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.062815:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b17e52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae8e expref: 36 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.062865:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4543da8900) 00010000:00010000:2.0:1784935728.062868:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784935728.062872:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300200, rc 0) 00000100:00100000:2.0:1784935728.063050:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+36:15639:x1871640273229184:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 603us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935728.063074:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 59 00000100:00100000:2.0:1784935728.068030:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935728.068700:0:18703:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273229312 00000100:00100000:1.0:1784935728.068721:0:18703:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273229312 00000100:00100000:2.0:1784935728.068983:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:2.0:1784935728.069016:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45adfc-e178-41b7-9e70-f7155e381607+6:2391:x1871640273229312:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784935728.069035:0:18706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784935728.069098:0:18706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b677469c/0x857e02f4e0b17e59 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae95 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784935728.069504:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63f530, blocks: 0x0 00010000:00010000:2.0:1784935728.069528:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1784935728.069533:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935728.069543:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b677469c/0x857e02f4e0b17e59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae95 expref: 7 pid: 18706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.069561:0:18706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b677469c/0x857e02f4e0b17e59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae95 expref: 7 pid: 18706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.069574:0:18706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d457d300800, rc 0) 00000100:00100000:2.0:1784935728.069655:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45adfc-e178-41b7-9e70-f7155e381607+7:2391:x1871640273229312:12345-192.168.203.28@tcp:101:lhsmtool_posix.0 Request processed in 663us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935728.069693:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 25 00000100:00100000:2.0:1784935728.072350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.072437:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273229568 00000100:00100000:0.0:1784935728.072446:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273229568 00000100:00100000:0.0:1784935728.072501:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 60 00000100:00100000:0.0:1784935728.072512:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+36:15639:x1871640273229568:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784935728.072618:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+36:15639:x1871640273229568:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 107us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935728.072639:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 60 00000100:00100000:3.0:1784935728.074833:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935728.075128:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273229696 00000100:00100000:2.0:1784935728.075147:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273229696 00000100:00100000:2.0:1784935728.075201:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 61 00000100:00100000:2.0:1784935728.075210:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+36:15639:x1871640273229696:12345-192.168.203.28@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784935728.080106:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1784935728.080129:0:17178:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1784935728.080181:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1784935728.080273:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.080284:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.080291:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.080296:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:1.0:1784935728.080300:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.080307:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.080321:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:1.0:1784935728.080323:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1784935728.080328:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.080333:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8c00/0x857e02f4e0b17ce6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935728.080496:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784935728.080512:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292172288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784935728.080574:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935728.080665:0:18705:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292172288 00000100:00100000:0.0:1784935728.080672:0:18705:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292172288 00000100:00100000:0.0:1784935728.080739:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784935728.080752:0:18705:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292172288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1784935728.080874:0:18705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784935728.080877:0:18705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1784935728.080879:0:18705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784935728.080881:0:18705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1784935728 -> 1784935728 00002000:00010000:0.0:1784935728.080883:0:18705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1784935728.080924:0:18705:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1871640292172288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (349us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784935728.080958:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1784935728.080998:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d4566eb6d80/2, rc 0, transno 8589934596 00000100:00100000:0.0:1784935728.081003:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292172288:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1784935728.081127:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784935728.081575:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45adfc-e178-41b7-9e70-f7155e381607+19:15639:x1871640273229696:12345-192.168.203.28@tcp:44:lhsmtool_posix.0 Request processed in 6363us (6748us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935728.081583:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 61 00000100:00100000:3.0:1784935728.083735:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.083828:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273229824 00000100:00100000:0.0:1784935728.083837:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273229824 00000100:00100000:0.0:1784935728.083894:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 27 00000100:00100000:0.0:1784935728.083904:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45adfc-e178-41b7-9e70-f7155e381607+7:2392:x1871640273229824:12345-192.168.203.28@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784935728.084025:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45adfc-e178-41b7-9e70-f7155e381607+7:2392:x1871640273229824:12345-192.168.203.28@tcp:16:lhsmtool_posix.0 Request processed in 122us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935728.084034:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 27 00010000:00010000:2.0:1784935728.084988:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085003:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085010:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085017:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540031800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935728.085021:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085029:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085046:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d45705a8a00) 00010000:00010000:2.0:1784935728.085049:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935728.085054:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085059:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031800/0x857e02f4e0b17c92 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085099:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085107:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085122:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085127:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935728.085130:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085347:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085357:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d45705a8100) 00010000:00010000:2.0:1784935728.085359:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935728.085363:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085368:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030600/0x857e02f4e0b17c99 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085381:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085387:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085393:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085405:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541529800 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935728.085408:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085414:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085422:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d45512ed700) 00010000:00010000:2.0:1784935728.085425:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935728.085428:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085433:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529800/0x857e02f4e0b17d41 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085449:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085455:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085461:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085465:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030c00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935728.085468:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085474:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085494:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:2.0:1784935728.085497:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784935728.085500:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085505:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030c00/0x857e02f4e0b17dc6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085516:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085522:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085527:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085532:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:2.0:1784935728.085534:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085539:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085546:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4543da8900) 00010000:00010000:2.0:1784935728.085547:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784935728.085550:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.085554:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030a00/0x857e02f4e0b17e3d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935728.086969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935728.087294:0:18430:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273230080 00000100:00100000:2.0:1784935728.087304:0:18430:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273230080 00000100:00100000:2.0:1784935728.087347:0:18430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 62 00000100:00100000:2.0:1784935728.087356:0:18430:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+15:15639:x1871640273230080:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784935728.087407:0:18430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935728.087428:0:18430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300200/0x857e02f4e0b17e52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae8e expref: 15 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.087446:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4543da8900) 00010000:00010000:2.0:1784935728.087449:0:18430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784935728.087477:0:18430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e60 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.087490:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.087499:0:18430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784935728.087613:0:18430:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000522be0c2 reply state 00000000e242474d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.087625:0:18430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300000/0x857e02f4e0b17e60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.087631:0:18430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4543da8900) 00010000:00010000:2.0:1784935728.087634:0:18430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784935728.087637:0:18430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784935728.087855:0:18430:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45adfc-e178-41b7-9e70-f7155e381607+16:15639:x1871640273230080:12345-192.168.203.28@tcp:36:lhsmtool_posix.0 Request processed in 499us (893us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1784935728.087874:0:18430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 62 00000100:00100000:3.0:1784935728.092821:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.092913:0:18705:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273230208 00000100:00100000:0.0:1784935728.092922:0:18705:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273230208 00000100:00100000:0.0:1784935728.093030:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 28 00000100:00100000:0.0:1784935728.093041:0:18705:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d45adfc-e178-41b7-9e70-f7155e381607+7:2392:x1871640273230208:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784935728.093209:0:18705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784935728.093213:0:18705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1784935727 00002000:00010000:0.0:1784935728.093216:0:18705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1784935727 00002000:00010000:0.0:1784935728.093218:0:18705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1784935728 -> 1784935727 00002000:00010000:0.0:1784935728.093221:0:18705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1784935728.093278:0:18705:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d45adfc-e178-41b7-9e70-f7155e381607+8:2392:x1871640273230208:12345-192.168.203.28@tcp:2:lhsmtool_posix.0 Request processed in 239us (466us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1784935728.093285:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 28 00000100:00100000:1.0:1784935728.095886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.096180:0:18706:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273230336 00000100:00100000:0.0:1784935728.096190:0:18706:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273230336 00000100:00100000:0.0:1784935728.096240:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 29 00000100:00100000:0.0:1784935728.096251:0:18706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45adfc-e178-41b7-9e70-f7155e381607+8:2392:x1871640273230336:12345-192.168.203.28@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784935728.096296:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0a6269a/0x857e02f4e0b17e67 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.096313:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935728.096318:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784935728.096325:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0a6269a/0x857e02f4e0b17e67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.096339:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0a6269a/0x857e02f4e0b17e67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.096364:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0a6269a/0x857e02f4e0b17e67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.096386:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0a6269a/0x857e02f4e0b17e67 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.096395:0:18706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0a6269a/0x857e02f4e0b17e67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.096402:0:18706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030000 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:0.0:1784935728.096407:0:18706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0a6269a/0x857e02f4e0b17e67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.096415:0:18706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0a6269a/0x857e02f4e0b17e67 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.096431:0:18706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0a6269a/0x857e02f4e0b17e67 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.096439:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0a6269a/0x857e02f4e0b17e67 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935728.096522:0:18706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45adfc-e178-41b7-9e70-f7155e381607+8:2392:x1871640273230336:12345-192.168.203.28@tcp:1:lhsmtool_posix.0 Request processed in 273us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935728.096530:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 29 00000100:00100000:2.0:1784935728.100492:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935728.100596:0:17197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273230592 00000100:00100000:3.0:1784935728.100606:0:17197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273230592 00000100:00100000:3.0:1784935728.100689:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 63 00000100:00100000:3.0:1784935728.100700:0:17197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+16:15639:x1871640273230592:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784935728.100778:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.100857:0:17197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17dbf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae5d expref: 16 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.100868:0:17197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.100904:0:17197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17dbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae5d expref: 16 pid: 18430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.100918:0:17197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17dbf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae5d expref: 16 pid: 18430 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935728.102912:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574334e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17197:1871640292172416:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935728.103233:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549408840 going to sleep for 11 seconds 00000100:00100000:2.0:1784935728.106440:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.106516:0:17184:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273230720 00000100:00100000:0.0:1784935728.106526:0:17184:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273230720 00010000:00010000:0.0:1784935728.106565:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17dbf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae5d expref: 17 pid: 18430 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935728.106618:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 19 00000100:00100000:0.0:1784935728.106628:0:17184:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d45adfc-e178-41b7-9e70-f7155e381607+17:2392:x1871640273230720:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784935728.106644:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784935728.106651:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17dbf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae5d expref: 17 pid: 18430 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.106662:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17dbf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae5d expref: 17 pid: 18430 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.106683:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:0.0:1784935728.106689:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17ddb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae6b expref: 17 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.106698:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.106705:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.106712:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.106729:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784935728.106785:0:17184:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d45adfc-e178-41b7-9e70-f7155e381607+17:2392:x1871640273230720:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 159us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935728.106792:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 19 00010000:00010000:3.0:1784935728.107883:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540031c00/0x857e02f4e0b17dbf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae5d expref: 16 pid: 18430 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935728.107903:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574334e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17197:1871640292172416:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935728.107923:0:17197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.107957:0:17197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.107964:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.108365:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.108385:0:17197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17e44 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae87 expref: 16 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.108393:0:17197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.108425:0:17197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17e44 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae87 expref: 16 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.108438:0:17197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17e44 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae87 expref: 16 pid: 17197 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935728.108463:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574334e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17197:1871640292172544:192.168.203.28@tcp:104: 00000100:00100000:3.0:1784935728.108537:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d45494649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935728.111728:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:1.0:1784935728.111917:0:17183:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273230848 00000100:00100000:1.0:1784935728.111962:0:17183:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273230848 00010000:00010000:1.0:1784935728.112003:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17e44 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae87 expref: 17 pid: 17197 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935728.112034:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 20 00000100:00100000:1.0:1784935728.112043:0:17183:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d45adfc-e178-41b7-9e70-f7155e381607+17:2391:x1871640273230848:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784935728.112058:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784935728.112065:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17e44 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae87 expref: 17 pid: 17197 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.112077:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17e44 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae87 expref: 17 pid: 17197 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.112098:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4543da8900) 00010000:00010000:1.0:1784935728.112103:0:17183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.112124:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.112325:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.112349:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784935728.112407:0:17183:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d45adfc-e178-41b7-9e70-f7155e381607+17:2391:x1871640273230848:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 365us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935728.112415:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 20 00010000:00010000:3.0:1784935728.113210:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529000/0x857e02f4e0b17e44 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae87 expref: 16 pid: 17197 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784935728.113228:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574334e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17197:1871640292172544:192.168.203.28@tcp:104: 00010000:00010000:3.0:1784935728.113246:0:17197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.113255:0:17197:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.113260:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784935728.113359:0:17197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1784935728.113487:0:17197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1784935728.113521:0:17197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1784935728.113591:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574334e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17197:1871640292172672:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784935728.113676:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935728.113714:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549464600 going to sleep for 11 seconds 00000100:00100000:2.0:1784935728.113853:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292172672 00000100:00100000:2.0:1784935728.113859:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292172672 00000100:00100000:2.0:1784935728.113903:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784935728.113912:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17197:x1871640292172672:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784935728.114014:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17197:x1871640292172672:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935728.114022:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784935728.114175:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574334e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17197:1871640292172672:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1784935728.114317:0:17197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1784935728.114358:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17197:1871640292172800:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784935728.114387:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935728.114412:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292172800 00000100:00100000:0.0:1784935728.114416:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292172800 00000100:00100000:0.0:1784935728.114440:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784935728.114447:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17197:x1871640292172800:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784935728.114545:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17197:x1871640292172800:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (157us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1784935728.114552:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784935728.114569:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549464c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784935728.114585:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17197:1871640292172800:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1784935728.114612:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114620:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114627:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114633:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528a00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935728.114638:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114646:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114661:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4543da8900) 00010000:00010000:0.0:1784935728.114672:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784935728.114677:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114683:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528a00/0x857e02f4e0b17e75 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114711:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114717:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114723:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114728:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8e00 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935728.114731:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114737:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114746:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:0.0:1784935728.114748:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784935728.114754:0:17197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17ddb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae6b expref: 19 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114764:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17ddb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae6b expref: 19 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.114773:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17ddb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae6b expref: 19 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.115059:0:17197:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d300c00/0x857e02f4e0b17ddb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae6b expref: 19 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935728.115071:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17197:1871640292172928:192.168.203.28@tcp:105: 00000100:00100000:0.0:1784935728.115282:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d4549464c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784935728.118476:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4566eb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17197:1871640292172928:192.168.203.28@tcp:105: 00010000:00010000:0.0:1784935728.118503:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118513:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d457d1b8e00/0x857e02f4e0b17dd4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118544:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030000/0x857e02f4e0b17e7c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118557:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030000/0x857e02f4e0b17e7c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118567:0:17197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030000/0x857e02f4e0b17e7c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118577:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030000/0x857e02f4e0b17e7c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118582:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030000/0x857e02f4e0b17e7c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118589:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030000/0x857e02f4e0b17e7c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118611:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030000 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935728.118615:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030000/0x857e02f4e0b17e7c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118622:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030000/0x857e02f4e0b17e7c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118633:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:0.0:1784935728.118636:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784935728.118641:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030000/0x857e02f4e0b17e7c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118648:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030000/0x857e02f4e0b17e7c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118658:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118664:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118670:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118675:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4541528600 already unused, calling callback (ffffffffc18c54f0) 00010000:00010000:0.0:1784935728.118677:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118683:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118701:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:0.0:1784935728.118703:0:17197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784935728.118706:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.118711:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528600/0x857e02f4e0b17e6e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17197 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935728.118879:0:17197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45adfc-e178-41b7-9e70-f7155e381607+19:15639:x1871640273230592:12345-192.168.203.28@tcp:57:lhsmtool_posix.0 Request processed in 18180us (18395us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1784935728.118889:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 63 00000020:00080000:0.0:1784935728.118895:0:17197:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1784935728.119428:0:17233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784935728.119434:0:17233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784935728.119468:0:17233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1784935728.119475:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1784935728.121550:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.121618:0:17200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273230976 00000100:00100000:0.0:1784935728.121628:0:17200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273230976 00000100:00100000:0.0:1784935728.121684:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00100000:0.0:1784935728.121695:0:17200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443660050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45adfc-e178-41b7-9e70-f7155e381607+19:15638:x1871640273230976:12345-192.168.203.28@tcp:49:dd.0 00000100:00100000:0.0:1784935728.121833:0:17200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443660050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45adfc-e178-41b7-9e70-f7155e381607+19:15638:x1871640273230976:12345-192.168.203.28@tcp:49:dd.0 Request processed in 140us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935728.121841:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 10 00000100:00100000:1.0:1784935728.124344:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:0.0:1784935728.124463:0:17200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273231232 00000100:00100000:0.0:1784935728.124472:0:17200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273231232 00000100:00100000:0.0:1784935728.124518:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 11 00000100:00100000:0.0:1784935728.124527:0:17200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45adfc-e178-41b7-9e70-f7155e381607+19:15639:x1871640273231232:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784935728.124767:0:17200:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784935728.124796:0:17200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1784935728.124841:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17e83 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.124868:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17e83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.124879:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17e83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.124886:0:17200:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17e83 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.124891:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17e83 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.124897:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17e83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784935728.124920:0:17200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784935728.125018:0:17200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45adfc-e178-41b7-9e70-f7155e381607+21:15639:x1871640273231232:12345-192.168.203.28@tcp:35:lhsmtool_posix.0 Request processed in 492us (684us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1784935728.125025:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 11 00000020:00080000:0.0:1784935728.125029:0:17200:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784935728.125236:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784935728.125243:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17e83 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.125251:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d4540030200 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:3.0:1784935728.125255:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17e83 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.125262:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17e83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.125274:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d4543da8900) 00010000:00010000:3.0:1784935728.125277:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784935728.125282:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17e83 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.125287:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4540030200/0x857e02f4e0b17e83 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.125300:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935728.125302:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935728.125304:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935728.128860:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:3.0:1784935728.128966:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273231360 00000100:00100000:3.0:1784935728.128977:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273231360 00000100:00100000:3.0:1784935728.129031:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 64 00000100:00100000:3.0:1784935728.129042:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+21:15638:x1871640273231360:12345-192.168.203.28@tcp:101:dd.0 00010000:00010000:3.0:1784935728.129078:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784935728.129102:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17e8a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x992e448fd313ae9c expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.129153:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528000/0x857e02f4e0b17e91 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.129166:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528000/0x857e02f4e0b17e91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.129176:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528000/0x857e02f4e0b17e91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.129278:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541529c00/0x857e02f4e0b17e8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae9c expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.129295:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d4541528000/0x857e02f4e0b17e91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae9c expref: 22 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.129303:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d45512eda00) 00010000:00010000:3.0:1784935728.129306:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784935728.129309:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d4541528000, rc 0) 00000100:00100000:3.0:1784935728.129358:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45adfc-e178-41b7-9e70-f7155e381607+22:15638:x1871640273231360:12345-192.168.203.28@tcp:101:dd.0 Request processed in 318us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935728.129365:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 64 00000100:00100000:0.0:1784935728.262337:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935728.262439:0:18709:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273231488 00000100:00100000:2.0:1784935728.262448:0:18709:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273231488 00000100:00100000:2.0:1784935728.262515:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 0 00000100:00100000:2.0:1784935728.262526:0:18709:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4566eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d45adfc-e178-41b7-9e70-f7155e381607+8:2394:x1871640273231488:12345-192.168.203.28@tcp:4:dd.0 00010000:00010000:2.0:1784935728.262559:0:18709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.262579:0:18709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b677469c/0x857e02f4e0b17e59 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae95 expref: 8 pid: 18706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.262605:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935728.262610:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935728.262615:0:18709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.262649:0:18709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b677469c/0x857e02f4e0b17e59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae95 expref: 8 pid: 18706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.262663:0:18709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b677469c/0x857e02f4e0b17e59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae95 expref: 8 pid: 18706 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935728.262679:0:18709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d35180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18709:1871640292173056:192.168.203.28@tcp:104: 00000100:00100000:2.0:1784935728.262763:0:18709:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d457026dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784935728.267636:0:18709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d35180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18709:1871640292173056:192.168.203.28@tcp:104: 00010000:00010000:2.0:1784935728.267665:0:18709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784935728.271538:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935728.271837:0:17185:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273231744 00000100:00100000:2.0:1784935728.271846:0:17185:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273231744 00010000:00010000:2.0:1784935728.271894:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b677469c/0x857e02f4e0b17e59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae95 expref: 9 pid: 18706 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784935728.271957:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 21 00000100:00100000:2.0:1784935728.271968:0:17185:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d45adfc-e178-41b7-9e70-f7155e381607+9:2392:x1871640273231744:12345-192.168.203.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784935728.271996:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784935728.272017:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b677469c/0x857e02f4e0b17e59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae95 expref: 9 pid: 18706 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.272041:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b677469c/0x857e02f4e0b17e59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae95 expref: 9 pid: 18706 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.272063:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b677469c/0x857e02f4e0b17e59 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.28@tcp remote: 0x992e448fd313ae95 expref: 9 pid: 18706 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.272081:0:17185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935728.272086:0:17185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784935728.272101:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.272115:0:17185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784935728.272164:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784935728.272225:0:17185:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d45adfc-e178-41b7-9e70-f7155e381607+8:2392:x1871640273231744:12345-192.168.203.28@tcp:103:ldlm_bl.0 Request processed in 258us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935728.272232:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 21 00010000:00010000:3.0:1784935728.272853:0:18709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784935728.272863:0:18709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935728.282736:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.28@tcp (source: 12345-192.168.203.28@tcp) 00000100:00100000:2.0:1784935728.283072:0:18711:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784935728.283083:0:18711:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1784935728.283456:0:18711:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640273231616 00000100:00100000:2.0:1784935728.283466:0:18711:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640273231616 00000100:00100000:1.0:1784935728.289263:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.28@tcp, seq: 1 00000100:00100000:1.0:1784935728.289283:0:20337:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5d45adfc-e178-41b7-9e70-f7155e381607+9:2394:x1871640273231616:12345-192.168.203.28@tcp:4:dd.0 00010000:00010000:1.0:1784935728.289325:0:20337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee4cf3a3/0x857e02f4e0b17e9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.289343:0:20337:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935728.289348:0:20337:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784935728.289354:0:20337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee4cf3a3/0x857e02f4e0b17e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.289370:0:20337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee4cf3a3/0x857e02f4e0b17e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784935728.393714:0:18700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1784935728.393734:0:18700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1784935728.399318:0:18709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1784935728.399327:0:18709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1784935727 -> 1784935728 00002000:00010000:1.0:1784935728.399330:0:18709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1784935727 -> 1784935728 00002000:00010000:1.0:1784935728.399332:0:18709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1784935728.399350:0:18709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.399362:0:18709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.399370:0:18709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.399395:0:18709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d300600 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935728.399400:0:18709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.399409:0:18709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.399428:0:18709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.399435:0:18709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019f29179/0x857e02f4e0b17e98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935728.399582:0:18709:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4566eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d45adfc-e178-41b7-9e70-f7155e381607+7:2394:x1871640273231488:12345-192.168.203.28@tcp:4:dd.0 Request processed in 137053us (137250us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1784935728.399592:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 0 00000001:00080000:2.0:1784935728.416715:0:18700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1784935728.417519:0:20337:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1784935728.417525:0:20337:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1784935728.417541:0:20337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee4cf3a3/0x857e02f4e0b17e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.417555:0:20337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee4cf3a3/0x857e02f4e0b17e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.417564:0:20337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee4cf3a3/0x857e02f4e0b17e9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.417584:0:20337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d457d1b8c00 already unused, calling callback (ffffffffc0c99310) 00010000:00010000:1.0:1784935728.417589:0:20337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee4cf3a3/0x857e02f4e0b17e9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.417598:0:20337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee4cf3a3/0x857e02f4e0b17e9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.417618:0:20337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee4cf3a3/0x857e02f4e0b17e9f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784935728.417627:0:20337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee4cf3a3/0x857e02f4e0b17e9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784935728.417721:0:20337:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5d45adfc-e178-41b7-9e70-f7155e381607+5:2394:x1871640273231616:12345-192.168.203.28@tcp:4:dd.0 Request processed in 128441us (134990us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1784935728.417731:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.28@tcp, seq: 1 00010000:00010000:0.0:1784935728.430203:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784935729.459083:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784935729.581550:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784935729.581572:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292173184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784935729.581634:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935729.582207:0:17203:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292173184 00000100:00100000:0.0:1784935729.582215:0:17203:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292173184 00000100:00100000:0.0:1784935729.582296:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784935729.582305:0:17203:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292173184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784935729.582358:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1784935729.582444:0:17203:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292173184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935729.582468:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784935729.582525:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292173184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784935729.595402:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784935729.595446:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292173312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784935729.595584:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784935729.595657:0:17202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292173312 00000100:00100000:0.0:1784935729.595673:0:17202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292173312 00000100:00100000:0.0:1784935729.595736:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784935729.595747:0:17202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292173312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784935729.595804:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784935729.595875:0:17202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1871640292173312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935729.595882:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784935729.595950:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1871640292173312:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1784935730.010351:0:20375:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1784935730.096377:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292173440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784935730.096490:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935730.096646:0:18707:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292173440 00000100:00100000:1.0:1784935730.096653:0:18707:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292173440 00000100:00100000:1.0:1784935730.096703:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784935730.096711:0:18707:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292173440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784935730.096736:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00080000:2.0:1784935730.096793:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784935730.096874:0:18707:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292173440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935730.096880:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784935730.096924:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1784935730.097587:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d4566eb6d80, transno 8589934596 00000004:00080000:0.0:1784935730.097608:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1784935730.097647:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292173440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784935730.477143:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784935730.608774:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4574005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292173568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784935730.608879:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935730.609282:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784935730.609296:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292173696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784935730.609333:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935730.609361:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292173824:0@lo:400:kworker.0 00000100:00100000:3.0:1784935730.609406:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935730.609444:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292174336:0@lo:400:kworker.0 00000100:00100000:2.0:1784935730.609450:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292174080:0@lo:400:kworker.0 00000100:00100000:1.0:1784935730.609486:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292173952:0@lo:400:kworker.0 00000100:00100000:2.0:1784935730.609488:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935730.609498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935730.609513:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292174592:0@lo:400:kworker.0 00000100:00100000:3.0:1784935730.609524:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d444359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292174848:0@lo:400:kworker.0 00000100:00100000:1.0:1784935730.609538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935730.609551:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935730.609566:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935730.609578:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292174464:0@lo:400:kworker.0 00000100:00100000:3.0:1784935730.609595:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784935730.609598:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292174080 00000100:00100000:2.0:1784935730.609605:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292174080 00000100:00100000:3.0:1784935730.609606:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292174208:0@lo:400:kworker.0 00000100:00100000:1.0:1784935730.609614:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784935730.609640:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292174976:0@lo:400:kworker.0 00000100:00100000:2.0:1784935730.609647:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292174592 00000100:00100000:3.0:1784935730.609648:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935730.609653:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292174592 00000100:00100000:1.0:1784935730.609671:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784935730.609677:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d4443598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292174720:0@lo:400:kworker.0 00000100:00100000:2.0:1784935730.609687:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292174848 00000100:00100000:2.0:1784935730.609691:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292174848 00000100:00100000:1.0:1784935730.609704:0:17192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292173824 00000100:00100000:3.0:1784935730.609710:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784935730.609710:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292174464 00000100:00100000:1.0:1784935730.609711:0:17192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292173824 00000100:00100000:2.0:1784935730.609715:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292174464 00000100:00100000:2.0:1784935730.609741:0:17198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292174976 00000100:00100000:3.0:1784935730.609744:0:17199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292174720 00000100:00100000:2.0:1784935730.609745:0:17198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292174976 00000100:00100000:3.0:1784935730.609752:0:17199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292174720 00000100:00100000:1.0:1784935730.609758:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784935730.609769:0:17192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d44437a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3652:x1871640292173824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935730.609772:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784935730.609782:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292174080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935730.609789:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784935730.609798:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d444359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292174592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935730.609838:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1871640292174080:12345-0@lo:400:kworker.0 Request processed in 56us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935730.609849:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784935730.609853:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d444359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1871640292174592:12345-0@lo:400:kworker.0 Request processed in 54us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935730.609863:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784935730.609876:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784935730.609886:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292174848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935730.609887:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784935730.609892:0:17192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d44437a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c8b4eee-3769-4cc8-9dd4-4824356c9813+24:3652:x1871640292173824:12345-0@lo:400:kworker.0 Request processed in 124us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784935730.609901:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292174464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935730.609903:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784935730.609955:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1871640292174848:12345-0@lo:400:kworker.0 Request processed in 71us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935730.609974:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292173952 00000100:00100000:3.0:1784935730.609975:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871640292174464:12345-0@lo:400:kworker.0 Request processed in 74us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784935730.609975:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784935730.609981:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292173952 00000100:00100000:3.0:1784935730.609990:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784935730.609999:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784935730.610008:0:17198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292174976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935730.610013:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784935730.610023:0:17199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292174720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784935730.610030:0:17938:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292174208 00000100:00100000:1.0:1784935730.610034:0:17938:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292174208 00000100:00100000:2.0:1784935730.610048:0:17198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871640292174976:12345-0@lo:400:kworker.0 Request processed in 41us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935730.610060:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784935730.610061:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784935730.610068:0:17199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1871640292174720:12345-0@lo:400:kworker.0 Request processed in 45us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935730.610073:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4443591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292173952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784935730.610081:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1784935730.610086:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784935730.610092:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784935730.610133:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1871640292174080:0@lo:400:kworker.0 00000100:00100000:1.0:1784935730.610139:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4443591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871640292173952:12345-0@lo:400:kworker.0 Request processed in 67us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935730.610147:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784935730.610152:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1871640292174592:0@lo:400:kworker.0 00000100:00100000:0.0:1784935730.610169:0:18708:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292173568 00000100:00100000:0.0:1784935730.610175:0:18708:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292173568 00000100:00100000:1.0:1784935730.610176:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784935730.610186:0:17938:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292174208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784935730.610220:0:18705:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292174336 00000100:00100000:0.0:1784935730.610220:0:18708:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871640292173696 00000100:00100000:2.0:1784935730.610225:0:18705:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292174336 00000100:00100000:0.0:1784935730.610226:0:18708:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871640292173696 00000100:00100000:1.0:1784935730.610231:0:17938:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292174208:12345-0@lo:400:kworker.0 Request processed in 46us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935730.610239:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784935730.610262:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784935730.610273:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784935730.610283:0:18705:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292174336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784935730.610289:0:18708:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292173568:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784935730.610296:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292174208:0@lo:400:kworker.0 00010000:00080000:1.0:1784935730.610313:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443598380 x1871640292174720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1784935730.610315:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784935730.610327:0:18705:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292174336:12345-0@lo:400:kworker.0 Request processed in 45us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1784935730.610332:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1871640292174720:0@lo:400:kworker.0 00000100:00100000:2.0:1784935730.610339:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784935730.610368:0:18708:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1871640292173568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935730.610375:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1784935730.610381:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784935730.610385:0:17193:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784935730.610393:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784935730.610401:0:18708:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8d4574335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292173696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784935730.610411:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784935730.610420:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4574005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1871640292173568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784935730.610443:0:18708:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8d4574335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1871640292173696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1784935730.610452:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784935730.610556:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871640292174464:0@lo:400:kworker.0 00000100:00100000:1.0:1784935730.610571:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292174336:0@lo:400:kworker.0 00010000:00080000:3.0:1784935730.610579:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d4443598e00 x1871640292174976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784935746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784935730.610587:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d444359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1871640292174848:0@lo:400:kworker.0 00000100:00100000:3.0:1784935730.610593:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1871640292174976:0@lo:400:kworker.0 00000100:00100000:1.0:1784935730.610601:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c8b4eee-3769-4cc8-9dd4-4824356c9813:3652:1871640292173824:0@lo:400:kworker.0 00000100:00100000:3.0:1784935730.610613:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1871640292173952:0@lo:400:kworker.0 00000100:00100000:1.0:1784935730.610622:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d4443d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1871640292173696:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1784935731.182080:0:17233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784935731.182090:0:17233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784935731.182142:0:17233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784935731.182150:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1784935731.503215:0:19714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41712 lines, 41712 kept, 0 dropped, 0 bad.